Oct 30 23:32:32.967281 ip-10-0-138-142 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Oct 30 23:32:32.967293 ip-10-0-138-142 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Oct 30 23:32:32.967302 ip-10-0-138-142 systemd[1]: kubelet.service: Failed with result 'resources'. Oct 30 23:32:32.967608 ip-10-0-138-142 systemd[1]: Failed to start Kubernetes Kubelet. Oct 30 23:32:43.504007 ip-10-0-138-142 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Oct 30 23:32:43.504018 ip-10-0-138-142 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5f712467d18e423d938e109621d5be9b -- Oct 30 23:34:29.174337 ip-10-0-138-142 systemd[1]: Starting Kubernetes Kubelet... Oct 30 23:34:29.530062 ip-10-0-138-142 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 23:34:29.530062 ip-10-0-138-142 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 23:34:29.530062 ip-10-0-138-142 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 23:34:29.530529 ip-10-0-138-142 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 23:34:29.534660 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534600 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:29.534660 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534659 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534663 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534666 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534668 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534671 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534674 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534677 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534679 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534682 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534684 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534687 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534689 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534692 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534695 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534697 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534700 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534702 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534706 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534708 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534711 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:29.534725 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534713 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534716 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534718 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534721 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534725 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534730 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534743 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534748 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534751 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534754 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534756 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534759 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534761 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534764 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534766 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534769 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534771 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534774 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534776 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:29.535202 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534779 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534782 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534784 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534787 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534789 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534791 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534794 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534797 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534800 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534803 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534808 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534811 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534814 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534818 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534821 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534824 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534826 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534829 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534831 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:29.535649 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534834 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534836 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534839 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534841 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534844 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534846 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534849 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534852 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534854 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534857 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534860 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534862 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534865 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534867 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534870 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534872 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534875 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534877 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534880 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:29.536114 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534884 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534887 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534890 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534892 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534895 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534898 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534900 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534903 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534905 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534908 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534911 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534913 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534916 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534918 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534921 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534923 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534926 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534928 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534931 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:29.536562 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534933 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534936 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534938 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534941 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534944 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534946 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534949 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534952 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.534955 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535697 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535704 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535707 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535710 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535713 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535717 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535720 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535723 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535725 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535728 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535730 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:29.537000 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535733 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535736 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535739 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535741 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535744 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535747 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535749 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535752 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535755 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535757 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535760 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535762 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535765 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535767 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535770 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535773 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535776 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535778 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535781 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535783 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:29.537500 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535786 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535788 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535791 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535793 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535797 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535801 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535804 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535807 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535810 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535813 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535816 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535818 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535821 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535823 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535826 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535828 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535831 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535834 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535836 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:29.537980 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535838 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535842 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535844 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535847 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535849 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535851 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535854 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535856 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535859 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535861 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535864 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535867 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535869 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535872 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535875 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535877 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535880 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535883 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535887 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:29.538462 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535889 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535892 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535895 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535898 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535901 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535903 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535906 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535908 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535911 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535913 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535918 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535922 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535925 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535928 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535930 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535933 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535935 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535938 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535940 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535943 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:29.538916 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535945 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535948 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535951 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535953 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535956 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535958 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535961 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535963 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535966 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535968 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535971 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535974 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535977 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535979 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535982 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535985 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.535987 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536474 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536480 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536483 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:29.539417 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536487 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536490 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536493 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536495 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536498 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536500 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536503 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536506 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536509 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536511 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536514 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536516 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536519 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536521 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536524 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536527 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536530 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536532 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536536 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:29.539907 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536540 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536542 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536545 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536548 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536550 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536553 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536555 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536558 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536561 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536563 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536566 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536569 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536572 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536574 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536577 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536579 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536582 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536584 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536587 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536589 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:29.540406 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536592 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536594 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536597 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536599 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536602 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536604 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536606 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536609 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536612 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536614 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536617 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536619 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536622 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536625 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536627 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536630 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536632 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536635 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536638 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536640 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:29.540904 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536643 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536646 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536648 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536651 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536653 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536656 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536658 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536661 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536663 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536666 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536669 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536671 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536674 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536676 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536679 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536682 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536684 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536687 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536689 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536693 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:29.541385 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536695 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536698 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536701 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536703 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536706 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536708 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536711 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536713 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536716 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536718 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536723 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536727 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536730 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536733 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536736 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536738 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536741 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536743 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536746 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:29.541852 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536748 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536751 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536753 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536755 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.536758 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537486 2576 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537499 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537505 2576 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537509 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537514 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537516 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537521 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537526 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537529 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537532 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537536 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537539 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537542 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537545 2576 flags.go:64] FLAG: --cgroup-root="" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537548 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537551 2576 flags.go:64] FLAG: --client-ca-file="" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537554 2576 flags.go:64] FLAG: --cloud-provider="external" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537557 2576 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 23:34:29.542311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537561 2576 flags.go:64] FLAG: --cluster-domain="" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537564 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537567 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537570 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537574 2576 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537578 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537581 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537584 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537587 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537590 2576 flags.go:64] FLAG: --contention-profiling="false" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537593 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537596 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537599 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537602 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537606 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537611 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537614 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537617 2576 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537620 2576 flags.go:64] FLAG: --enable-server="true" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537623 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537627 2576 flags.go:64] FLAG: --event-burst="100" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537630 2576 flags.go:64] FLAG: --event-qps="50" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537633 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537636 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 23:34:29.542842 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537639 2576 flags.go:64] FLAG: --eviction-hard="" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537643 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537652 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537656 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537659 2576 flags.go:64] FLAG: --eviction-soft="" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537662 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537665 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537668 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537671 2576 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537674 2576 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537677 2576 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537680 2576 flags.go:64] FLAG: --feature-gates="" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537684 2576 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537687 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537691 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537694 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537697 2576 flags.go:64] FLAG: --healthz-port="10248" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537700 2576 flags.go:64] FLAG: --help="false" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537703 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537706 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537709 2576 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537711 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537715 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 23:34:29.543524 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537719 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537722 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537725 2576 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537728 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537731 2576 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537734 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537737 2576 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537740 2576 flags.go:64] FLAG: --kube-reserved="" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537743 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537746 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537749 2576 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537752 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537755 2576 flags.go:64] FLAG: --lock-file="" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537757 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537760 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537763 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537769 2576 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537771 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537774 2576 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537778 2576 flags.go:64] FLAG: --logging-format="text" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537781 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537784 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537787 2576 flags.go:64] FLAG: --manifest-url="" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537790 2576 flags.go:64] FLAG: --manifest-url-header="" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537795 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 23:34:29.544163 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537798 2576 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537802 2576 flags.go:64] FLAG: --max-pods="110" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537805 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537810 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537813 2576 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537816 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537819 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537823 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537826 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537833 2576 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537836 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537839 2576 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537842 2576 flags.go:64] FLAG: --pod-cidr="" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537845 2576 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537848 2576 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537851 2576 flags.go:64] FLAG: --pods-per-core="0" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537854 2576 flags.go:64] FLAG: --port="10250" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537857 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537860 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05cfafc999a216fe2" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537863 2576 flags.go:64] FLAG: --qos-reserved="" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537866 2576 flags.go:64] FLAG: --read-only-port="10255" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537869 2576 flags.go:64] FLAG: --register-node="true" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537872 2576 flags.go:64] FLAG: --register-with-taints="" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537876 2576 flags.go:64] FLAG: --registry-burst="10" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537878 2576 flags.go:64] FLAG: --registry-qps="5" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537881 2576 flags.go:64] FLAG: --reserved-cpus="" Oct 30 23:34:29.544742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537884 2576 flags.go:64] FLAG: --reserved-memory="" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537888 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537891 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537894 2576 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537897 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537900 2576 flags.go:64] FLAG: --runonce="false" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537903 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537906 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537909 2576 flags.go:64] FLAG: --seccomp-default="false" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537914 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537917 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537920 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537923 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537927 2576 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537930 2576 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537933 2576 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537936 2576 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537939 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537942 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537945 2576 flags.go:64] FLAG: --system-cgroups="" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537948 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537953 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537956 2576 flags.go:64] FLAG: --tls-cert-file="" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537959 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537963 2576 flags.go:64] FLAG: --tls-min-version="" Oct 30 23:34:29.545363 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537966 2576 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537969 2576 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537972 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537994 2576 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.537998 2576 flags.go:64] FLAG: --v="2" Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.538002 2576 flags.go:64] FLAG: --version="false" Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.538006 2576 flags.go:64] FLAG: --vmodule="" Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.538010 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.538014 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538155 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538159 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538162 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538165 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538168 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538171 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538175 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538180 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538184 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538186 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538189 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538192 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:29.545962 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538195 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538197 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538200 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538203 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538206 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538208 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538213 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538216 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538219 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538222 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538225 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538227 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538230 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538233 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538235 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538238 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538240 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538243 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538245 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:29.547097 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538248 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538250 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538253 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538255 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538258 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538261 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538263 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538266 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538270 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538272 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538275 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538278 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538280 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538283 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538285 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538288 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538290 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538293 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538295 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538298 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:29.547558 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538300 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538303 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538305 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538308 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538311 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538313 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538315 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538318 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538320 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538323 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538325 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538328 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538330 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538333 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538336 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538338 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538341 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538343 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538346 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538348 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:29.548073 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538352 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538355 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538357 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538360 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538362 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538365 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538368 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538370 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538372 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538375 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538378 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538380 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538383 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538385 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538388 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538390 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538393 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538396 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538398 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538401 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:29.548544 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538403 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538406 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538408 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538411 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538413 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538416 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538418 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538421 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538424 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538426 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538429 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538431 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538435 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538438 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538441 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.538466 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 23:34:29.549050 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538505 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538509 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538512 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538515 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538518 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538520 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538523 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538525 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538528 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538531 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538533 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538536 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538538 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538541 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538543 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538546 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538549 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538551 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538554 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538556 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:29.549453 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538559 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538561 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538564 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538568 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538570 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538573 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538576 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538579 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538583 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538585 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538589 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538591 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538594 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538597 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538599 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538602 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538604 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538607 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538609 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538612 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:29.549938 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538616 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538620 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538622 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538625 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538628 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538630 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538633 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538635 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538638 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538640 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538643 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538645 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538649 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538653 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538656 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538660 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538663 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538666 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538668 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:29.550418 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538671 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538675 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538678 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538681 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538684 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538686 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538689 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538692 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538694 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538697 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538700 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538702 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538705 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538707 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538710 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538712 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538715 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538717 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538720 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538722 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:29.550853 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538725 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538727 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538730 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538732 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538735 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538737 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538740 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538742 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538746 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538749 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538752 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538754 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538757 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538761 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538764 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538766 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538769 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538772 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538774 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:29.551357 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538777 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538780 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538782 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538785 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538787 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538791 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538793 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.538796 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.544869 2576 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.544884 2576 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.544897 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.544902 2576 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.544973 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.544978 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.544981 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.544984 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.544988 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.544991 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.544993 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:29.551799 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.544996 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.544999 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545002 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545005 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545007 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545010 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545012 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545015 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545018 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545020 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545023 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545025 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545028 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545031 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545034 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545036 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545050 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545053 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545056 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:29.552441 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545058 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545061 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545064 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545073 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545077 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545080 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545082 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545085 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545088 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545090 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545093 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545096 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545098 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545101 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545104 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545106 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545109 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545111 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545113 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:29.553071 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545116 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545118 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545121 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545123 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545126 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545128 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545131 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545134 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545136 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545139 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545141 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545144 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545147 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545149 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545152 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545154 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545158 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545167 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545170 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545172 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:29.553624 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545174 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545177 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545180 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545182 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545185 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545187 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545189 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545192 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545194 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545197 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545199 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545202 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545204 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545207 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545209 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545212 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545214 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545216 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545219 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:29.554201 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545221 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545224 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545226 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545229 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545231 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545234 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545236 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545239 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545243 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545248 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545251 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545260 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545264 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545267 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545270 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545272 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545275 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545278 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545280 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:29.554698 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545283 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545285 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545288 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.545316 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545537 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545543 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545546 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545548 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545551 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545555 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545559 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545562 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545564 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545567 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545570 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545572 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:29.555176 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545575 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545583 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545586 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545588 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545591 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545594 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545597 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545599 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545602 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545611 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545614 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545617 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545619 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545622 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545624 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545627 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545629 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545632 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545634 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:29.555552 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545636 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545641 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545644 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545657 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545660 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545663 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545666 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545668 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545671 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545673 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545675 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545678 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545681 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545683 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545686 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545688 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545691 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545693 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545696 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:29.556004 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545699 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545701 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545704 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545706 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545715 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545718 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545721 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545723 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545726 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545728 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545731 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545733 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545736 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545738 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545741 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545743 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545746 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545748 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545751 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545753 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:29.556458 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545756 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545758 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545761 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545763 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545766 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545769 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545772 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545774 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545777 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545780 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545782 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545785 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545787 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545790 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545792 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545795 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545797 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545805 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545808 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:29.556931 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545811 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545813 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545816 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545818 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545821 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545823 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545826 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545828 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545830 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545833 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545835 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545838 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545840 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545843 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545845 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545847 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:29.557389 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545850 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.545875 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545919 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545923 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545927 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545930 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545932 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545935 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545938 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545941 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545943 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545946 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545949 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545951 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545954 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545962 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:29.557772 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545965 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545967 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545970 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545973 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545976 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545978 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545981 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545983 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545986 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545988 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545991 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545993 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545996 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.545998 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546001 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546004 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546006 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546009 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546011 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546014 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:29.558204 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546016 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546019 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546021 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546024 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546026 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546029 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546031 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546034 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546036 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546049 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546052 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546056 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546066 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546069 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546072 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546075 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546077 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546080 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546083 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:29.558700 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546086 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546088 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546091 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546093 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546096 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546098 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546103 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546106 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546108 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546111 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546113 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546116 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546118 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546121 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546124 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546127 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546129 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546132 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546134 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:29.559194 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546138 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546142 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546145 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546148 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546151 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546154 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546156 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546165 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546168 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546171 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546173 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546177 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546179 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546182 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546185 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546187 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546190 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546192 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546195 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546199 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:29.559634 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546202 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546204 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546207 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546210 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546212 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546215 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546217 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546220 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546223 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546225 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546228 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546230 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546233 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:29.546235 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.546298 2576 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.548324 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.549147 2576 server.go:1014] "Starting client certificate rotation" Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.549680 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 23:34:29.560112 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.549721 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 23:34:29.560543 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.551243 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 23:34:29.560543 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.555194 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 23:34:29.563180 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.563163 2576 log.go:25] "Validated CRI v1 runtime API" Oct 30 23:34:29.566418 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.566403 2576 log.go:25] "Validated CRI v1 image API" Oct 30 23:34:29.567188 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.567165 2576 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 23:34:29.569576 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.569555 2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7d2e8b83-6351-48dc-97b7-79aa82cb0009:/dev/nvme0n1p3 de0527ee-ee33-4dc4-a33d-9fefbabf5d93:/dev/nvme0n1p4] Oct 30 23:34:29.569653 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.569574 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 30 23:34:29.574452 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.574341 2576 manager.go:217] Machine: {Timestamp:2026-10-30 23:34:29.57311213 +0000 UTC m=+0.295832541 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100068 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22abd6de4cf302434f9be6c9fccfcc SystemUUID:ec22abd6-de4c-f302-434f-9be6c9fccfcc BootID:5f712467-d18e-423d-938e-109621d5be9b Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d9:68:f9:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d9:68:f9:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:7c:46:81:28:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 23:34:29.574452 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.574445 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 23:34:29.574610 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.574561 2576 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 23:34:29.577420 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.577393 2576 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 23:34:29.577580 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.577422 2576 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-142.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 23:34:29.577676 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.577585 2576 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 23:34:29.577676 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.577596 2576 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 23:34:29.577676 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.577608 2576 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 23:34:29.577676 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.577624 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 23:34:29.578568 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.578554 2576 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 23:34:29.582753 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.582739 2576 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 23:34:29.582882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.582871 2576 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 23:34:29.583555 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.583544 2576 kubelet.go:493] "Attempting to sync node with API server" Oct 30 23:34:29.583609 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.583561 2576 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 23:34:29.583609 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.583574 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 23:34:29.583609 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.583587 2576 kubelet.go:405] "Adding apiserver pod source" Oct 30 23:34:29.583609 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.583597 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 23:34:29.583901 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.583888 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 23:34:29.585817 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.585799 2576 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 23:34:29.591561 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.591548 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 23:34:29.592422 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.592410 2576 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 23:34:29.592481 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.592451 2576 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 23:34:29.592608 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.592595 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 23:34:29.592657 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.592613 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 23:34:29.592657 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.592624 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 23:34:29.592657 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.592631 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 23:34:29.592657 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.592640 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 23:34:29.592657 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.592648 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 23:34:29.593161 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.593150 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 23:34:29.593161 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.593161 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 23:34:29.593262 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.593168 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 23:34:29.593262 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.593174 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 23:34:29.593262 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.593190 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 23:34:29.593262 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.593199 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 23:34:29.593856 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.593846 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 23:34:29.593856 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.593855 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 23:34:29.597918 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.597902 2576 server.go:1263] "Started kubelet" Oct 30 23:34:29.598154 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.598026 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 23:34:29.598154 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.598070 2576 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 23:34:29.598154 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.598110 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 23:34:29.598548 ip-10-0-138-142 systemd[1]: Started Kubernetes Kubelet. Oct 30 23:34:29.599315 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.599297 2576 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 23:34:29.601020 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.600467 2576 server.go:317] "Adding debug handlers to kubelet server" Oct 30 23:34:29.604010 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.603993 2576 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 30 23:34:29.605120 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.605104 2576 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 23:34:29.605120 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.605117 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 23:34:29.605247 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.605201 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-142.ec2.internal\" not found" Oct 30 23:34:29.605780 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.605758 2576 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 23:34:29.605780 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.605782 2576 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 23:34:29.605901 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.605758 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 23:34:29.605901 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.605875 2576 reconstruct.go:97] "Volume reconstruction finished" Oct 30 23:34:29.605901 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.605884 2576 reconciler.go:29] "Reconciler: start to sync state" Oct 30 23:34:29.606443 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.606415 2576 factory.go:55] Registering systemd factory Oct 30 23:34:29.606443 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.606430 2576 factory.go:223] Registration of the systemd container factory successfully Oct 30 23:34:29.606611 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.606599 2576 factory.go:153] Registering CRI-O factory Oct 30 23:34:29.606673 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.606613 2576 factory.go:223] Registration of the crio container factory successfully Oct 30 23:34:29.606673 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.606660 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 23:34:29.606775 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.606677 2576 factory.go:103] Registering Raw factory Oct 30 23:34:29.606775 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.606693 2576 manager.go:1199] Started watching for new ooms in manager Oct 30 23:34:29.607569 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.607555 2576 manager.go:319] Starting recovery of all containers Oct 30 23:34:29.622058 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.620177 2576 manager.go:324] Recovery completed Oct 30 23:34:29.625702 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.625641 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-142.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 30 23:34:29.626538 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.625654 2576 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 30 23:34:29.626917 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.626903 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 23:34:29.627423 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.625656 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-142.ec2.internal.18e372c59767c0da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-142.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-142.ec2.internal,},FirstTimestamp:2026-10-30 23:34:29.597872346 +0000 UTC m=+0.320592755,LastTimestamp:2026-10-30 23:34:29.597872346 +0000 UTC m=+0.320592755,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-142.ec2.internal,}" Oct 30 23:34:29.628532 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.628503 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientMemory" Oct 30 23:34:29.628617 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.628541 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 23:34:29.628617 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.628555 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientPID" Oct 30 23:34:29.629108 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.629094 2576 cpu_manager.go:226] "Starting" policy="none" Oct 30 23:34:29.629108 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.629106 2576 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 23:34:29.629205 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.629125 2576 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 23:34:29.629205 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.629149 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 23:34:29.629820 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.629803 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientMemory" Oct 30 23:34:29.629892 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.629829 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 23:34:29.629892 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.629842 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientPID" Oct 30 23:34:29.631359 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.631346 2576 policy_none.go:50] "Start" Oct 30 23:34:29.631359 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.631361 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 23:34:29.631445 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.631371 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 23:34:29.633388 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.633378 2576 policy_none.go:44] "Start" Oct 30 23:34:29.643152 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.643133 2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 23:34:29.645072 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.645034 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 30 23:34:29.645162 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.645093 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 30 23:34:29.645162 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.645092 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 30 23:34:29.645303 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.645229 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-142.ec2.internal.18e372c5993b85b7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-142.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-142.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-142.ec2.internal,},FirstTimestamp:2026-10-30 23:34:29.628528055 +0000 UTC m=+0.351248468,LastTimestamp:2026-10-30 23:34:29.628528055 +0000 UTC m=+0.351248468,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-142.ec2.internal,}" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.666594 2576 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.667268 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-142.ec2.internal.18e372c5993bd428 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-142.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-142.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-142.ec2.internal,},FirstTimestamp:2026-10-30 23:34:29.628548136 +0000 UTC m=+0.351268555,LastTimestamp:2026-10-30 23:34:29.628548136 +0000 UTC m=+0.351268555,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-142.ec2.internal,}" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.668130 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.669345 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.669369 2576 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.669391 2576 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.669429 2576 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.669553 2576 manager.go:341] "Starting Device Plugin manager" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.670093 2576 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.670113 2576 server.go:87] "Starting device plugin registration server" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.670349 2576 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.670361 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.670499 2576 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.670601 2576 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.670609 2576 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.671518 2576 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 23:34:29.679309 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.671581 2576 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-142.ec2.internal\" not found" Oct 30 23:34:29.684431 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.684357 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-142.ec2.internal.18e372c5993c00f4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-142.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-142.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-142.ec2.internal,},FirstTimestamp:2026-10-30 23:34:29.628559604 +0000 UTC m=+0.351280014,LastTimestamp:2026-10-30 23:34:29.628559604 +0000 UTC m=+0.351280014,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-142.ec2.internal,}" Oct 30 23:34:29.708128 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.708108 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" Oct 30 23:34:29.708215 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.708145 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-142.ec2.internal.18e372c5993b85b7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-142.ec2.internal.18e372c5993b85b7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-142.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-142.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-142.ec2.internal,},FirstTimestamp:2026-10-30 23:34:29.628528055 +0000 UTC m=+0.351248468,LastTimestamp:2026-10-30 23:34:29.629816176 +0000 UTC m=+0.352536586,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-142.ec2.internal,}" Oct 30 23:34:29.727894 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.727828 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-142.ec2.internal.18e372c5993bd428\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-142.ec2.internal.18e372c5993bd428 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-142.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-142.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-142.ec2.internal,},FirstTimestamp:2026-10-30 23:34:29.628548136 +0000 UTC m=+0.351268555,LastTimestamp:2026-10-30 23:34:29.629835266 +0000 UTC m=+0.352555676,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-142.ec2.internal,}" Oct 30 23:34:29.747845 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.747827 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5pnsb" Oct 30 23:34:29.749729 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.749673 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-142.ec2.internal.18e372c5993c00f4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-142.ec2.internal.18e372c5993c00f4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-142.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-142.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-142.ec2.internal,},FirstTimestamp:2026-10-30 23:34:29.628559604 +0000 UTC m=+0.351280014,LastTimestamp:2026-10-30 23:34:29.629846381 +0000 UTC m=+0.352566791,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-142.ec2.internal,}" Oct 30 23:34:29.754964 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.754950 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5pnsb" Oct 30 23:34:29.769989 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.769971 2576 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal"] Oct 30 23:34:29.770077 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.770018 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 23:34:29.770505 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.770489 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 23:34:29.770716 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.770699 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientMemory" Oct 30 23:34:29.770809 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.770726 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 23:34:29.770809 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.770738 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientPID" Oct 30 23:34:29.771116 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.771101 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientMemory" Oct 30 23:34:29.771182 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.771124 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 23:34:29.771182 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.771141 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientPID" Oct 30 23:34:29.771182 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.771159 2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.772994 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.772980 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 23:34:29.773141 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.773128 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.773214 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.773153 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 23:34:29.773688 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.773672 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientMemory" Oct 30 23:34:29.773755 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.773703 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 23:34:29.773755 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.773716 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientMemory" Oct 30 23:34:29.773755 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.773733 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 23:34:29.773755 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.773742 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientPID" Oct 30 23:34:29.773940 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.773718 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientPID" Oct 30 23:34:29.776159 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.776145 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.776208 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.776171 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 23:34:29.776836 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.776823 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientMemory" Oct 30 23:34:29.776900 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.776848 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 23:34:29.776900 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.776859 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientPID" Oct 30 23:34:29.791691 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.791676 2576 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.791757 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.791694 2576 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-142.ec2.internal\": node \"ip-10-0-138-142.ec2.internal\" not found" Oct 30 23:34:29.808449 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.808429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f1359870aca54abc3605a4dc88b335-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal\" (UID: \"81f1359870aca54abc3605a4dc88b335\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.808545 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.808481 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/115f903faf6fce7f69241f9f5ad98f46-config\") pod \"kube-apiserver-proxy-ip-10-0-138-142.ec2.internal\" (UID: \"115f903faf6fce7f69241f9f5ad98f46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.808545 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.808517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81f1359870aca54abc3605a4dc88b335-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal\" (UID: \"81f1359870aca54abc3605a4dc88b335\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.811642 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.811624 2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-142.ec2.internal\" not found" node="ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.815030 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.815014 2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-142.ec2.internal\" not found" node="ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.832170 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.832154 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-142.ec2.internal\" not found" Oct 30 23:34:29.908794 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.908776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/115f903faf6fce7f69241f9f5ad98f46-config\") pod \"kube-apiserver-proxy-ip-10-0-138-142.ec2.internal\" (UID: \"115f903faf6fce7f69241f9f5ad98f46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.908860 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.908796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81f1359870aca54abc3605a4dc88b335-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal\" (UID: \"81f1359870aca54abc3605a4dc88b335\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.908860 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.908814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f1359870aca54abc3605a4dc88b335-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal\" (UID: \"81f1359870aca54abc3605a4dc88b335\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.908942 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.908871 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f1359870aca54abc3605a4dc88b335-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal\" (UID: \"81f1359870aca54abc3605a4dc88b335\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.908942 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.908881 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/115f903faf6fce7f69241f9f5ad98f46-config\") pod \"kube-apiserver-proxy-ip-10-0-138-142.ec2.internal\" (UID: \"115f903faf6fce7f69241f9f5ad98f46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.908942 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:29.908880 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81f1359870aca54abc3605a4dc88b335-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal\" (UID: \"81f1359870aca54abc3605a4dc88b335\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:34:29.932213 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:29.932189 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-142.ec2.internal\" not found" Oct 30 23:34:30.032392 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:30.032372 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-142.ec2.internal\" not found" Oct 30 23:34:30.115855 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:30.115809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:34:30.118994 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:30.118978 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" Oct 30 23:34:30.132805 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:30.132701 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-142.ec2.internal\" not found" Oct 30 23:34:30.233609 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:30.233590 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-142.ec2.internal\" not found" Oct 30 23:34:30.334108 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:30.334090 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-142.ec2.internal\" not found" Oct 30 23:34:30.434788 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:30.434729 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-142.ec2.internal\" not found" Oct 30 23:34:30.535183 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:30.535158 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-142.ec2.internal\" not found" Oct 30 23:34:30.550315 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:30.550296 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 30 23:34:30.632636 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:30.632610 2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:34:30.696368 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:30.696341 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81f1359870aca54abc3605a4dc88b335.slice/crio-58757b0008ba867b2086eadb26788481e45832055b279909d6619130d9134d76 WatchSource:0}: Error finding container 58757b0008ba867b2086eadb26788481e45832055b279909d6619130d9134d76: Status 404 returned error can't find the container with id 58757b0008ba867b2086eadb26788481e45832055b279909d6619130d9134d76 Oct 30 23:34:30.696689 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:30.696670 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod115f903faf6fce7f69241f9f5ad98f46.slice/crio-988486dce3f256714cfe3346a9788e386da2da5064aa8fe4d85ff7ab40642adb WatchSource:0}: Error finding container 988486dce3f256714cfe3346a9788e386da2da5064aa8fe4d85ff7ab40642adb: Status 404 returned error can't find the container with id 988486dce3f256714cfe3346a9788e386da2da5064aa8fe4d85ff7ab40642adb Oct 30 23:34:30.701810 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:30.701797 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 23:34:30.706220 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:30.706204 2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:34:30.731219 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:30.731203 2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 23:34:30.732831 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:30.732819 2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" Oct 30 23:34:30.753540 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:30.753525 2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 23:34:30.759594 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:30.759566 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 23:29:29 +0000 UTC" deadline="2028-06-11 12:24:42.141409972 +0000 UTC" Oct 30 23:34:30.759594 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:30.759589 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14148h50m11.381823324s" Oct 30 23:34:30.794411 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:30.794395 2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:34:30.908879 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:30.908858 2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:34:31.290191 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.290149 2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:34:31.584886 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.584815 2576 apiserver.go:52] "Watching apiserver" Oct 30 23:34:31.606295 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.606270 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 30 23:34:31.614701 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.614672 2576 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 23:34:31.615086 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.615060 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-lxbgd","openshift-image-registry/node-ca-xcbst","openshift-network-diagnostics/network-check-target-2rjct","openshift-network-operator/iptables-alerter-9tldd","kube-system/konnectivity-agent-tmkjs","kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal","openshift-multus/network-metrics-daemon-cf6r4","openshift-multus/multus-wxzm8","openshift-ovn-kubernetes/ovnkube-node-8vljc","kube-system/global-pull-secret-syncer-bqgch","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng","openshift-dns/node-resolver-kh84m","openshift-multus/multus-additional-cni-plugins-t2g7g"] Oct 30 23:34:31.617896 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.617876 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.620045 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.620023 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:34:31.622616 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.622598 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.624704 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.624684 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:34:31.627344 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.627315 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.630001 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.629985 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:31.630115 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:31.630063 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cf6r4" podUID="969fd947-a81d-4e6a-b369-550efce8f665" Oct 30 23:34:31.632250 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.632227 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:34:31.634712 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.634694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.634948 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.634927 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 23:34:31.635037 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.634989 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:34:31.635993 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.635951 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 23:34:31.636102 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.636022 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 23:34:31.645177 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.643690 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:31.645177 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:31.643781 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqgch" podUID="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" Oct 30 23:34:31.645177 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.644653 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wrqrm\"" Oct 30 23:34:31.645177 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.644749 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jsrq7\"" Oct 30 23:34:31.645177 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.644869 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 23:34:31.645177 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.644880 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 23:34:31.645177 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.644967 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 23:34:31.645177 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.644994 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8ljqd\"" Oct 30 23:34:31.645177 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.645126 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 23:34:31.645177 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.645127 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-65zfb\"" Oct 30 23:34:31.645789 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.645286 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 23:34:31.645789 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.645335 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 23:34:31.645789 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.645350 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 23:34:31.645789 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.645393 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:34:31.645789 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.645407 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 23:34:31.645789 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.645462 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 23:34:31.645789 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.645498 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-mp8rg\"" Oct 30 23:34:31.647566 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.647546 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.650263 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.650242 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kh84m" Oct 30 23:34:31.652700 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.652680 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:31.652779 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:31.652742 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rjct" podUID="3e87ca45-ff16-44e3-a360-5252e624f610" Oct 30 23:34:31.668104 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.668038 2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 23:34:31.668192 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.668094 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zs7l2" Oct 30 23:34:31.675962 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.675926 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" event={"ID":"115f903faf6fce7f69241f9f5ad98f46","Type":"ContainerStarted","Data":"988486dce3f256714cfe3346a9788e386da2da5064aa8fe4d85ff7ab40642adb"} Oct 30 23:34:31.677626 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.677601 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" event={"ID":"81f1359870aca54abc3605a4dc88b335","Type":"ContainerStarted","Data":"58757b0008ba867b2086eadb26788481e45832055b279909d6619130d9134d76"} Oct 30 23:34:31.707140 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.707121 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 23:34:31.719543 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.719523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-systemd-units\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.719645 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.719555 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-cni-bin\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.719645 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.719612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/931f746a-9d07-400d-9b4c-c16569e47a38-ovn-node-metrics-cert\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.719764 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.719673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-kubelet\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.719764 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.719743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj466\" (UniqueName: \"kubernetes.io/projected/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-kube-api-access-rj466\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:34:31.719864 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.719811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/580f7210-4806-4d98-95c0-a1b2613c1222-agent-certs\") pod \"konnectivity-agent-tmkjs\" (UID: \"580f7210-4806-4d98-95c0-a1b2613c1222\") " pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:34:31.719864 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.719841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-var-lib-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.719965 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.719866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-log-socket\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.719965 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.719892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-cni-binary-copy\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.719965 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.719918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb9b4\" (UniqueName: \"kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4\") pod \"network-check-target-2rjct\" (UID: \"3e87ca45-ff16-44e3-a360-5252e624f610\") " pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:31.719965 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.719942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-lib-modules\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.720212 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.719966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-iptables-alerter-script\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:34:31.720212 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.719992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:31.720212 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720017 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-systemd\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.720212 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720047 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-daemon-config\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.720212 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720094 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.720212 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-system-cni-dir\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.720212 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720151 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-slash\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.720212 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-ovnkube-script-lib\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.720212 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-cni-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.720595 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720225 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/580f7210-4806-4d98-95c0-a1b2613c1222-konnectivity-ca\") pod \"konnectivity-agent-tmkjs\" (UID: \"580f7210-4806-4d98-95c0-a1b2613c1222\") " pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:34:31.720595 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-serviceca\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:34:31.720595 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-cnibin\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.720595 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-etc-kubernetes\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.720595 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720321 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-device-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.720595 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-hosts-file\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:34:31.720595 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysconfig\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.720595 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5j9g\" (UniqueName: \"kubernetes.io/projected/969fd947-a81d-4e6a-b369-550efce8f665-kube-api-access-b5j9g\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:31.720595 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-env-overrides\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.720595 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720450 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.720595 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-cni-bin\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.720595 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720499 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vc5z\" (UniqueName: \"kubernetes.io/projected/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-kube-api-access-5vc5z\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.720595 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-run-netns\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.720595 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysctl-d\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-multus-certs\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-cni-multus\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-var-lib-kubelet\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-cni-netd\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720809 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720834 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-system-cni-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbpdj\" (UniqueName: \"kubernetes.io/projected/4c7342b5-72f1-461d-8a00-eff0e377a4fe-kube-api-access-fbpdj\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720891 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-dbus\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720916 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-kubernetes\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-host\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-tmp\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.720993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-node-log\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-run-ovn-kubernetes\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.721284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721042 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-k8s-cni-cncf-io\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-conf-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721094 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8b2p\" (UniqueName: \"kubernetes.io/projected/931f746a-9d07-400d-9b4c-c16569e47a38-kube-api-access-n8b2p\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-cnibin\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-kubelet\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-sys\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-ovn\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-ovnkube-config\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-socket-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-kubelet-config\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6ntz\" (UniqueName: \"kubernetes.io/projected/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-kube-api-access-c6ntz\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-run\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzhwj\" (UniqueName: \"kubernetes.io/projected/65fcac23-a536-479c-b515-28fbc7711990-kube-api-access-wzhwj\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-socket-dir-parent\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.722089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-hostroot\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.722891 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-registration-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.722891 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-sys-fs\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.722891 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysctl-conf\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.722891 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-systemd\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.722891 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff8p4\" (UniqueName: \"kubernetes.io/projected/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-kube-api-access-ff8p4\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.722891 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721652 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-etc-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.722891 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-host\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:34:31.722891 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-cni-binary-copy\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.722891 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-netns\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.722891 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-tmp-dir\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:34:31.722891 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-modprobe-d\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.722891 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-tuned\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.722891 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kx9g\" (UniqueName: \"kubernetes.io/projected/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-kube-api-access-7kx9g\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:34:31.722891 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.722891 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.721906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-host-slash\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:34:31.741206 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.741182 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 23:34:31.741284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.741234 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 23:34:31.741284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.741244 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 23:34:31.741284 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.741283 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 23:34:31.741401 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.741320 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 23:34:31.741401 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.741344 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 23:34:31.741401 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.741380 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 23:34:31.741522 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.741420 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 23:34:31.741522 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.741408 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 23:34:31.741617 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.741602 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 23:34:31.743679 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.743655 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 23:34:31.743785 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.743768 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 23:34:31.743841 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.743791 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2bmqg\"" Oct 30 23:34:31.743895 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.743853 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-5t726\"" Oct 30 23:34:31.743895 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.743865 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-swxmn\"" Oct 30 23:34:31.743994 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.743931 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l52wg\"" Oct 30 23:34:31.743994 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.743991 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 23:34:31.822327 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysconfig\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.822438 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5j9g\" (UniqueName: \"kubernetes.io/projected/969fd947-a81d-4e6a-b369-550efce8f665-kube-api-access-b5j9g\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:31.822438 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-env-overrides\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.822438 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822395 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.822438 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-cni-bin\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.822438 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822426 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysconfig\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.822695 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vc5z\" (UniqueName: \"kubernetes.io/projected/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-kube-api-access-5vc5z\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.822695 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-run-netns\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.822695 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-cni-bin\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.822695 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysctl-d\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.822695 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.822695 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822538 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-run-netns\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.822695 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-multus-certs\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.822695 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822592 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-cni-multus\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.822695 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.822695 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-var-lib-kubelet\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.822695 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-multus-certs\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.822695 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-cni-netd\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822706 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822673 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysctl-d\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-system-cni-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbpdj\" (UniqueName: \"kubernetes.io/projected/4c7342b5-72f1-461d-8a00-eff0e377a4fe-kube-api-access-fbpdj\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822780 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-var-lib-kubelet\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822751 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822790 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-cni-netd\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822751 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-cni-multus\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-dbus\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-system-cni-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822934 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822990 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-dbus\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.822994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-kubernetes\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823051 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-env-overrides\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-kubernetes\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.823237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823107 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-host\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823131 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-host\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-tmp\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-node-log\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-run-ovn-kubernetes\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823270 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-k8s-cni-cncf-io\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823293 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-conf-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8b2p\" (UniqueName: \"kubernetes.io/projected/931f746a-9d07-400d-9b4c-c16569e47a38-kube-api-access-n8b2p\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823329 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-run-ovn-kubernetes\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823363 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-cnibin\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823366 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-node-log\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-kubelet\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823393 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-sys\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-ovn\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-ovnkube-config\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.823802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-socket-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-kubelet-config\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ntz\" (UniqueName: \"kubernetes.io/projected/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-kube-api-access-c6ntz\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-run\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823487 2576 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzhwj\" (UniqueName: \"kubernetes.io/projected/65fcac23-a536-479c-b515-28fbc7711990-kube-api-access-wzhwj\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-socket-dir-parent\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-hostroot\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823563 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-k8s-cni-cncf-io\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-registration-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-sys-fs\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysctl-conf\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-systemd\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823641 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-registration-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff8p4\" (UniqueName: \"kubernetes.io/projected/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-kube-api-access-ff8p4\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-etc-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.824573 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-host\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-cni-binary-copy\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:31.823730 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-netns\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-tmp-dir\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:31.823776 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret podName:4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:32.323761345 +0000 UTC m=+3.046481782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret") pod "global-pull-secret-syncer-bqgch" (UID: "4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91") : object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823790 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-systemd\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823799 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-modprobe-d\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-tuned\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823853 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-modprobe-d\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kx9g\" (UniqueName: \"kubernetes.io/projected/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-kube-api-access-7kx9g\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-cnibin\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-host-slash\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-systemd-units\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823972 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-sys\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-cni-bin\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.825289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824007 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-ovn\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824011 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-tmp-dir\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/931f746a-9d07-400d-9b4c-c16569e47a38-ovn-node-metrics-cert\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-kubelet\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj466\" (UniqueName: \"kubernetes.io/projected/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-kube-api-access-rj466\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/580f7210-4806-4d98-95c0-a1b2613c1222-agent-certs\") pod \"konnectivity-agent-tmkjs\" (UID: \"580f7210-4806-4d98-95c0-a1b2613c1222\") " pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-var-lib-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-log-socket\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-cni-binary-copy\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb9b4\" (UniqueName: \"kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4\") pod \"network-check-target-2rjct\" (UID: \"3e87ca45-ff16-44e3-a360-5252e624f610\") " pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-lib-modules\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-iptables-alerter-script\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-systemd\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824265 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-etc-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-daemon-config\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.826075 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824306 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-host\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-system-cni-dir\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-slash\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824349 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-netns\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824351 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-ovnkube-script-lib\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-cni-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824410 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/580f7210-4806-4d98-95c0-a1b2613c1222-konnectivity-ca\") pod \"konnectivity-agent-tmkjs\" (UID: \"580f7210-4806-4d98-95c0-a1b2613c1222\") " pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-serviceca\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-cnibin\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-etc-kubernetes\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-device-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-hosts-file\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824592 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-hosts-file\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-cni-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.824811 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-ovnkube-script-lib\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.825275 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-conf-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.825298 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-var-lib-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.825318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-cnibin\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.826722 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.825344 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-sys-fs\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.827882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.825375 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-etc-kubernetes\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.827882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.825430 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-device-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.827882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.825448 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysctl-conf\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.827882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.825454 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-log-socket\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.827882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.825478 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-systemd\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.827882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.825809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/580f7210-4806-4d98-95c0-a1b2613c1222-konnectivity-ca\") pod \"konnectivity-agent-tmkjs\" (UID: \"580f7210-4806-4d98-95c0-a1b2613c1222\") " pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:34:31.827882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.825992 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-ovnkube-config\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.827882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.826122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.827882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.826138 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-lib-modules\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.827882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.826176 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-system-cni-dir\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.827882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.826762 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-kubelet-config\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:31.827882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.827126 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-run\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.827882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.827238 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-socket-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.827882 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:31.827302 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:31.827882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.827301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-host-slash\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:34:31.829399 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.829373 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.829506 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:31.829451 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs podName:969fd947-a81d-4e6a-b369-550efce8f665 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:32.32943403 +0000 UTC m=+3.052154443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs") pod "network-metrics-daemon-cf6r4" (UID: "969fd947-a81d-4e6a-b369-550efce8f665") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:31.829751 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.829732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.830002 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.829985 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-serviceca\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:34:31.830908 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.823929 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-kubelet\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.830908 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.830244 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-systemd-units\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.830908 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.830370 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-iptables-alerter-script\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:34:31.830908 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.830420 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-cni-binary-copy\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.830908 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.830602 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-daemon-config\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.830908 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.830612 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-tmp\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.830908 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.830702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-kubelet\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.830908 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.830765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-socket-dir-parent\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.830908 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.830850 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-hostroot\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.830908 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.830872 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/931f746a-9d07-400d-9b4c-c16569e47a38-ovn-node-metrics-cert\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.831503 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.831206 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-cni-binary-copy\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.831503 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.831221 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-slash\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.831503 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.831284 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-cni-bin\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.835402 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.835283 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-tuned\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.837656 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.837620 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/580f7210-4806-4d98-95c0-a1b2613c1222-agent-certs\") pod \"konnectivity-agent-tmkjs\" (UID: \"580f7210-4806-4d98-95c0-a1b2613c1222\") " pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:34:31.850038 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.850010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5j9g\" (UniqueName: \"kubernetes.io/projected/969fd947-a81d-4e6a-b369-550efce8f665-kube-api-access-b5j9g\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:31.850401 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.850377 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vc5z\" (UniqueName: \"kubernetes.io/projected/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-kube-api-access-5vc5z\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.850914 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.850890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbpdj\" (UniqueName: \"kubernetes.io/projected/4c7342b5-72f1-461d-8a00-eff0e377a4fe-kube-api-access-fbpdj\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:31.852148 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:31.851977 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 23:34:31.852148 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:31.852001 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 23:34:31.852148 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:31.852015 2576 projected.go:196] Error preparing data for projected volume kube-api-access-xb9b4 for pod openshift-network-diagnostics/network-check-target-2rjct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:31.852148 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:31.852080 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4 podName:3e87ca45-ff16-44e3-a360-5252e624f610 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:32.35204888 +0000 UTC m=+3.074769294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xb9b4" (UniqueName: "kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4") pod "network-check-target-2rjct" (UID: "3e87ca45-ff16-44e3-a360-5252e624f610") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:31.855056 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.854559 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6ntz\" (UniqueName: \"kubernetes.io/projected/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-kube-api-access-c6ntz\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:34:31.855056 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.854989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8b2p\" (UniqueName: \"kubernetes.io/projected/931f746a-9d07-400d-9b4c-c16569e47a38-kube-api-access-n8b2p\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:31.856820 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.856791 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff8p4\" (UniqueName: \"kubernetes.io/projected/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-kube-api-access-ff8p4\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.857487 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.857460 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kx9g\" (UniqueName: \"kubernetes.io/projected/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-kube-api-access-7kx9g\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:34:31.870527 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.870510 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzhwj\" (UniqueName: \"kubernetes.io/projected/65fcac23-a536-479c-b515-28fbc7711990-kube-api-access-wzhwj\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.874339 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.874301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj466\" (UniqueName: \"kubernetes.io/projected/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-kube-api-access-rj466\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:34:31.933854 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.933829 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:34:31.945274 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:31.945243 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b2eb3ea_17b1_4cec_ab47_27be6876bf69.slice/crio-f2740cffd7adf4526f34330a2352776e8c8545cb4cddadc05f555a4a1f375d19 WatchSource:0}: Error finding container f2740cffd7adf4526f34330a2352776e8c8545cb4cddadc05f555a4a1f375d19: Status 404 returned error can't find the container with id f2740cffd7adf4526f34330a2352776e8c8545cb4cddadc05f555a4a1f375d19 Oct 30 23:34:31.951291 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.951269 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:34:31.961377 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:31.961349 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9448c7a_5b0e_4ff7_808b_889a0d8b022f.slice/crio-068755fea0a800e579ba10501284cad9faad5ebbbbffad453a4fca4004cde717 WatchSource:0}: Error finding container 068755fea0a800e579ba10501284cad9faad5ebbbbffad453a4fca4004cde717: Status 404 returned error can't find the container with id 068755fea0a800e579ba10501284cad9faad5ebbbbffad453a4fca4004cde717 Oct 30 23:34:31.977123 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.977104 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:34:31.977192 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.977128 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:34:31.979278 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.979258 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wxzm8" Oct 30 23:34:31.985557 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:31.985539 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:34:31.988372 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:31.988348 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode260fd6e_f3d5_4a32_a6e4_afa7389ec4ae.slice/crio-f6fe21d35297426155014a540b350ba3eac1ad6b799958b5e36ad6dd8b6e5430 WatchSource:0}: Error finding container f6fe21d35297426155014a540b350ba3eac1ad6b799958b5e36ad6dd8b6e5430: Status 404 returned error can't find the container with id f6fe21d35297426155014a540b350ba3eac1ad6b799958b5e36ad6dd8b6e5430 Oct 30 23:34:31.994007 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:31.993933 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65fcac23_a536_479c_b515_28fbc7711990.slice/crio-fc4e4cbf8e5f95b33f56216046b7882d56a7aa518db039a3f4a3c06c944d1b54 WatchSource:0}: Error finding container fc4e4cbf8e5f95b33f56216046b7882d56a7aa518db039a3f4a3c06c944d1b54: Status 404 returned error can't find the container with id fc4e4cbf8e5f95b33f56216046b7882d56a7aa518db039a3f4a3c06c944d1b54 Oct 30 23:34:31.997534 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:31.997516 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded39bbb9_fa16_45b9_98e4_84c920c6a5df.slice/crio-124faafc1ba1f051802269f7bb65bdba6d7bd3d519761c3b34bbdeb39b82edac WatchSource:0}: Error finding container 124faafc1ba1f051802269f7bb65bdba6d7bd3d519761c3b34bbdeb39b82edac: Status 404 returned error can't find the container with id 124faafc1ba1f051802269f7bb65bdba6d7bd3d519761c3b34bbdeb39b82edac Oct 30 23:34:32.001527 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:32.001375 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580f7210_4806_4d98_95c0_a1b2613c1222.slice/crio-9eab77b969cfe6a38ff2e1adc053bdac9edf48a75e7d2033cd626f47db63b8e4 WatchSource:0}: Error finding container 9eab77b969cfe6a38ff2e1adc053bdac9edf48a75e7d2033cd626f47db63b8e4: Status 404 returned error can't find the container with id 9eab77b969cfe6a38ff2e1adc053bdac9edf48a75e7d2033cd626f47db63b8e4 Oct 30 23:34:32.012189 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.012059 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kh84m" Oct 30 23:34:32.014405 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.014386 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:34:32.016742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.016727 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:32.037777 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:32.037752 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7342b5_72f1_461d_8a00_eff0e377a4fe.slice/crio-a11c56075101b058a42fa52a8b4001c0c86f645b4ae466b89c29f23a0bc4e215 WatchSource:0}: Error finding container a11c56075101b058a42fa52a8b4001c0c86f645b4ae466b89c29f23a0bc4e215: Status 404 returned error can't find the container with id a11c56075101b058a42fa52a8b4001c0c86f645b4ae466b89c29f23a0bc4e215 Oct 30 23:34:32.038358 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:32.038147 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6ae729_bb57_4d5f_9112_69dc5d0abee9.slice/crio-92046e6e9c5c4299c3ceb15421d8cce7035f2c05bbd68917b4202d7e3f4b5fe0 WatchSource:0}: Error finding container 92046e6e9c5c4299c3ceb15421d8cce7035f2c05bbd68917b4202d7e3f4b5fe0: Status 404 returned error can't find the container with id 92046e6e9c5c4299c3ceb15421d8cce7035f2c05bbd68917b4202d7e3f4b5fe0 Oct 30 23:34:32.039059 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:34:32.039020 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod931f746a_9d07_400d_9b4c_c16569e47a38.slice/crio-0f1cf5eeb80ca0ba62a0d6ce731ed8aefa3a00f7757a43d55f44aac4f59ced4c WatchSource:0}: Error finding container 0f1cf5eeb80ca0ba62a0d6ce731ed8aefa3a00f7757a43d55f44aac4f59ced4c: Status 404 returned error can't find the container with id 0f1cf5eeb80ca0ba62a0d6ce731ed8aefa3a00f7757a43d55f44aac4f59ced4c Oct 30 23:34:32.327177 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.327027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:32.327275 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:32.327124 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:32.327275 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:32.327249 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret podName:4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:33.327236989 +0000 UTC m=+4.049957386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret") pod "global-pull-secret-syncer-bqgch" (UID: "4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91") : object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:32.427597 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.427540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb9b4\" (UniqueName: \"kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4\") pod \"network-check-target-2rjct\" (UID: \"3e87ca45-ff16-44e3-a360-5252e624f610\") " pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:32.427597 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.427567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:32.427735 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:32.427670 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:32.427735 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:32.427720 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs podName:969fd947-a81d-4e6a-b369-550efce8f665 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:33.427703445 +0000 UTC m=+4.150423847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs") pod "network-metrics-daemon-cf6r4" (UID: "969fd947-a81d-4e6a-b369-550efce8f665") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:32.427926 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:32.427897 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 23:34:32.427926 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:32.427917 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 23:34:32.427926 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:32.427927 2576 projected.go:196] Error preparing data for projected volume kube-api-access-xb9b4 for pod openshift-network-diagnostics/network-check-target-2rjct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:32.428149 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:32.427975 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4 podName:3e87ca45-ff16-44e3-a360-5252e624f610 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:33.427961938 +0000 UTC m=+4.150682341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xb9b4" (UniqueName: "kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4") pod "network-check-target-2rjct" (UID: "3e87ca45-ff16-44e3-a360-5252e624f610") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:32.672931 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.672820 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 23:29:31 +0000 UTC" deadline="2028-06-15 03:17:56.852576202 +0000 UTC" Oct 30 23:34:32.672931 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.672875 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14235h43m24.179705404s" Oct 30 23:34:32.700012 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.699882 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tmkjs" event={"ID":"580f7210-4806-4d98-95c0-a1b2613c1222","Type":"ContainerStarted","Data":"9eab77b969cfe6a38ff2e1adc053bdac9edf48a75e7d2033cd626f47db63b8e4"} Oct 30 23:34:32.706129 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.705485 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" event={"ID":"115f903faf6fce7f69241f9f5ad98f46","Type":"ContainerStarted","Data":"0120c49f8bcab1eef5daa5793da57af3fc41e8d6f9fe0ae7f7d4cc7e6b2b1416"} Oct 30 23:34:32.712366 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.711612 2576 generic.go:356] "Generic (PLEG): container finished" podID="81f1359870aca54abc3605a4dc88b335" containerID="a3eb80da9f885c402cb8a523c642d86488b49c8ce1436b096ab072bf22de1e8b" exitCode=0 Oct 30 23:34:32.712366 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.711691 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" event={"ID":"81f1359870aca54abc3605a4dc88b335","Type":"ContainerDied","Data":"a3eb80da9f885c402cb8a523c642d86488b49c8ce1436b096ab072bf22de1e8b"} Oct 30 23:34:32.716676 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.716605 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wxzm8" event={"ID":"ed39bbb9-fa16-45b9-98e4-84c920c6a5df","Type":"ContainerStarted","Data":"124faafc1ba1f051802269f7bb65bdba6d7bd3d519761c3b34bbdeb39b82edac"} Oct 30 23:34:32.727384 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.727364 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2g7g" event={"ID":"65fcac23-a536-479c-b515-28fbc7711990","Type":"ContainerStarted","Data":"fc4e4cbf8e5f95b33f56216046b7882d56a7aa518db039a3f4a3c06c944d1b54"} Oct 30 23:34:32.733827 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.733804 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9tldd" event={"ID":"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae","Type":"ContainerStarted","Data":"f6fe21d35297426155014a540b350ba3eac1ad6b799958b5e36ad6dd8b6e5430"} Oct 30 23:34:32.747054 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.745083 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" podStartSLOduration=2.745067377 podStartE2EDuration="2.745067377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:32.74427121 +0000 UTC m=+3.466991629" watchObservedRunningTime="2026-10-30 23:34:32.745067377 +0000 UTC m=+3.467787797" Oct 30 23:34:32.747054 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.745712 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xcbst" event={"ID":"c9448c7a-5b0e-4ff7-808b-889a0d8b022f","Type":"ContainerStarted","Data":"068755fea0a800e579ba10501284cad9faad5ebbbbffad453a4fca4004cde717"} Oct 30 23:34:32.755258 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.755204 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" event={"ID":"8b2eb3ea-17b1-4cec-ab47-27be6876bf69","Type":"ContainerStarted","Data":"f2740cffd7adf4526f34330a2352776e8c8545cb4cddadc05f555a4a1f375d19"} Oct 30 23:34:32.772774 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.772748 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" event={"ID":"931f746a-9d07-400d-9b4c-c16569e47a38","Type":"ContainerStarted","Data":"0f1cf5eeb80ca0ba62a0d6ce731ed8aefa3a00f7757a43d55f44aac4f59ced4c"} Oct 30 23:34:32.780313 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.780255 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kh84m" event={"ID":"fc6ae729-bb57-4d5f-9112-69dc5d0abee9","Type":"ContainerStarted","Data":"92046e6e9c5c4299c3ceb15421d8cce7035f2c05bbd68917b4202d7e3f4b5fe0"} Oct 30 23:34:32.809408 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:32.809386 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" event={"ID":"4c7342b5-72f1-461d-8a00-eff0e377a4fe","Type":"ContainerStarted","Data":"a11c56075101b058a42fa52a8b4001c0c86f645b4ae466b89c29f23a0bc4e215"} Oct 30 23:34:33.335742 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:33.335708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:33.335929 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:33.335886 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:33.335994 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:33.335945 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret podName:4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:35.335927008 +0000 UTC m=+6.058647432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret") pod "global-pull-secret-syncer-bqgch" (UID: "4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91") : object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:33.436977 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:33.436946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb9b4\" (UniqueName: \"kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4\") pod \"network-check-target-2rjct\" (UID: \"3e87ca45-ff16-44e3-a360-5252e624f610\") " pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:33.437188 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:33.437151 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 23:34:33.437188 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:33.437170 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 23:34:33.437188 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:33.437182 2576 projected.go:196] Error preparing data for projected volume kube-api-access-xb9b4 for pod openshift-network-diagnostics/network-check-target-2rjct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:33.437345 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:33.437232 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4 podName:3e87ca45-ff16-44e3-a360-5252e624f610 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:35.43721507 +0000 UTC m=+6.159935489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xb9b4" (UniqueName: "kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4") pod "network-check-target-2rjct" (UID: "3e87ca45-ff16-44e3-a360-5252e624f610") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:33.437550 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:33.436989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:33.437550 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:33.437538 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:33.437686 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:33.437607 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs podName:969fd947-a81d-4e6a-b369-550efce8f665 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:35.437588487 +0000 UTC m=+6.160308898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs") pod "network-metrics-daemon-cf6r4" (UID: "969fd947-a81d-4e6a-b369-550efce8f665") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:33.670698 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:33.670626 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:33.670919 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:33.670749 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rjct" podUID="3e87ca45-ff16-44e3-a360-5252e624f610" Oct 30 23:34:33.671169 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:33.671149 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:33.671273 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:33.671256 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cf6r4" podUID="969fd947-a81d-4e6a-b369-550efce8f665" Oct 30 23:34:33.671331 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:33.671322 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:33.671413 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:33.671395 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqgch" podUID="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" Oct 30 23:34:33.673845 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:33.673811 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 23:29:31 +0000 UTC" deadline="2028-05-17 06:13:55.042082778 +0000 UTC" Oct 30 23:34:33.674216 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:33.673847 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13542h39m21.368242047s" Oct 30 23:34:33.831357 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:33.830999 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" event={"ID":"81f1359870aca54abc3605a4dc88b335","Type":"ContainerStarted","Data":"542382d52031e4f6fa29670e106ef7bec56113ef3a8cc0705363cc5f8584b51e"} Oct 30 23:34:34.857844 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:34.857759 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2g7g" event={"ID":"65fcac23-a536-479c-b515-28fbc7711990","Type":"ContainerStarted","Data":"e31d5b94d25620d4bc4bdc784952922f4e80a9599a3412e830fdd52965dc0eac"} Oct 30 23:34:34.912920 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:34.912412 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" podStartSLOduration=4.912393853 podStartE2EDuration="4.912393853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:33.868921319 +0000 UTC m=+4.591641739" watchObservedRunningTime="2026-10-30 23:34:34.912393853 +0000 UTC m=+5.635114273" Oct 30 23:34:35.352803 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:35.352765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:35.352973 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:35.352941 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:35.353061 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:35.353000 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret podName:4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:39.352982016 +0000 UTC m=+10.075702414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret") pod "global-pull-secret-syncer-bqgch" (UID: "4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91") : object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:35.453757 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:35.453721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb9b4\" (UniqueName: \"kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4\") pod \"network-check-target-2rjct\" (UID: \"3e87ca45-ff16-44e3-a360-5252e624f610\") " pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:35.453944 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:35.453770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:35.453944 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:35.453930 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:35.454076 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:35.453988 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs podName:969fd947-a81d-4e6a-b369-550efce8f665 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:39.453970429 +0000 UTC m=+10.176690830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs") pod "network-metrics-daemon-cf6r4" (UID: "969fd947-a81d-4e6a-b369-550efce8f665") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:35.454424 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:35.454401 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 23:34:35.454500 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:35.454434 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 23:34:35.454500 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:35.454461 2576 projected.go:196] Error preparing data for projected volume kube-api-access-xb9b4 for pod openshift-network-diagnostics/network-check-target-2rjct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:35.454610 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:35.454507 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4 podName:3e87ca45-ff16-44e3-a360-5252e624f610 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:39.454492171 +0000 UTC m=+10.177212571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xb9b4" (UniqueName: "kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4") pod "network-check-target-2rjct" (UID: "3e87ca45-ff16-44e3-a360-5252e624f610") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:35.672604 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:35.672532 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:35.672756 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:35.672663 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqgch" podUID="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" Oct 30 23:34:35.673065 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:35.673030 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:35.673155 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:35.673141 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rjct" podUID="3e87ca45-ff16-44e3-a360-5252e624f610" Oct 30 23:34:35.673216 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:35.673204 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:35.673307 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:35.673289 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cf6r4" podUID="969fd947-a81d-4e6a-b369-550efce8f665" Oct 30 23:34:35.861451 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:35.861420 2576 generic.go:356] "Generic (PLEG): container finished" podID="65fcac23-a536-479c-b515-28fbc7711990" containerID="e31d5b94d25620d4bc4bdc784952922f4e80a9599a3412e830fdd52965dc0eac" exitCode=0 Oct 30 23:34:35.861744 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:35.861469 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2g7g" event={"ID":"65fcac23-a536-479c-b515-28fbc7711990","Type":"ContainerDied","Data":"e31d5b94d25620d4bc4bdc784952922f4e80a9599a3412e830fdd52965dc0eac"} Oct 30 23:34:36.866677 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:36.866627 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tmkjs" event={"ID":"580f7210-4806-4d98-95c0-a1b2613c1222","Type":"ContainerStarted","Data":"5872767c98072221e142fe4fd97fc88b6cc478fe1ef212d7726f91bba0647299"} Oct 30 23:34:36.905838 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:36.905769 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tmkjs" podStartSLOduration=3.17005931 podStartE2EDuration="6.905751615s" totalImagesPullingTime="3.735692305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:36.905238675 +0000 UTC m=+7.627959095" watchObservedRunningTime="2026-10-30 23:34:36.905751615 +0000 UTC m=+7.628472037" Oct 30 23:34:37.673029 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:37.672999 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:37.673213 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:37.673125 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:37.673213 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:37.673134 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cf6r4" podUID="969fd947-a81d-4e6a-b369-550efce8f665" Oct 30 23:34:37.673213 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:37.673192 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rjct" podUID="3e87ca45-ff16-44e3-a360-5252e624f610" Oct 30 23:34:37.673356 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:37.673232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:37.673356 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:37.673293 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqgch" podUID="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" Oct 30 23:34:37.871160 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:37.871094 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xcbst" event={"ID":"c9448c7a-5b0e-4ff7-808b-889a0d8b022f","Type":"ContainerStarted","Data":"ab5af74d7effe663cd0838671fae27187fcad251941c30841a27145f67e4f251"} Oct 30 23:34:38.878421 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:38.878387 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" event={"ID":"4c7342b5-72f1-461d-8a00-eff0e377a4fe","Type":"ContainerStarted","Data":"8465b78bd9676edc2bcca9293651f8e5cc9b5c9a922abb2cf67d470df07d353e"} Oct 30 23:34:39.366489 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.366455 2576 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 23:34:39.385496 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.385467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:39.385656 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:39.385643 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:39.385704 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:39.385695 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret podName:4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:47.385678304 +0000 UTC m=+18.108398702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret") pod "global-pull-secret-syncer-bqgch" (UID: "4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91") : object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:39.486328 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.486237 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb9b4\" (UniqueName: \"kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4\") pod \"network-check-target-2rjct\" (UID: \"3e87ca45-ff16-44e3-a360-5252e624f610\") " pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:39.486328 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.486284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:39.486481 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:39.486401 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:39.486481 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:39.486414 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 23:34:39.486481 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:39.486430 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 23:34:39.486481 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:39.486442 2576 projected.go:196] Error preparing data for projected volume kube-api-access-xb9b4 for pod openshift-network-diagnostics/network-check-target-2rjct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:39.486481 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:39.486455 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs podName:969fd947-a81d-4e6a-b369-550efce8f665 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:47.48643831 +0000 UTC m=+18.209158710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs") pod "network-metrics-daemon-cf6r4" (UID: "969fd947-a81d-4e6a-b369-550efce8f665") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:39.486679 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:39.486487 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4 podName:3e87ca45-ff16-44e3-a360-5252e624f610 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:47.486466162 +0000 UTC m=+18.209186575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xb9b4" (UniqueName: "kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4") pod "network-check-target-2rjct" (UID: "3e87ca45-ff16-44e3-a360-5252e624f610") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:39.543700 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.543676 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:34:39.544518 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.544497 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:34:39.582539 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.582483 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xcbst" podStartSLOduration=5.61759753 podStartE2EDuration="10.582467453s" totalImagesPullingTime="4.964869923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:37.909561115 +0000 UTC m=+8.632281534" watchObservedRunningTime="2026-10-30 23:34:39.582467453 +0000 UTC m=+10.305187873" Oct 30 23:34:39.674126 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.671517 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:39.674126 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:39.671617 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqgch" podUID="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" Oct 30 23:34:39.674126 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.671926 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:39.674126 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:39.672014 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rjct" podUID="3e87ca45-ff16-44e3-a360-5252e624f610" Oct 30 23:34:39.674126 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.672862 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:39.674126 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:39.672974 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cf6r4" podUID="969fd947-a81d-4e6a-b369-550efce8f665" Oct 30 23:34:39.677384 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.677006 2576 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T23:34:39.366477269Z","UUID":"64c92961-5deb-4721-ac52-76bcb3860479","Handler":null,"Name":"","Endpoint":""} Oct 30 23:34:39.682099 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.678485 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 23:34:39.682216 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.682112 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 23:34:39.882774 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.882746 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wxzm8" event={"ID":"ed39bbb9-fa16-45b9-98e4-84c920c6a5df","Type":"ContainerStarted","Data":"a207a904478c3cd75b6fbaaee77259094bab29c82dfdbfd80373b681b180df99"} Oct 30 23:34:39.885249 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.885222 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kh84m" event={"ID":"fc6ae729-bb57-4d5f-9112-69dc5d0abee9","Type":"ContainerStarted","Data":"25d2db43736d1c80773dd363ebd8ddf153ab0927a6308f6a8585243ff2878ee7"} Oct 30 23:34:39.887307 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.887283 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" event={"ID":"4c7342b5-72f1-461d-8a00-eff0e377a4fe","Type":"ContainerStarted","Data":"b4622a488f2c8c7e4308fd760e36705d18c905dea1f6a1c41839435544fb19a7"} Oct 30 23:34:39.937130 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.937076 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-wxzm8" podStartSLOduration=3.406033393 podStartE2EDuration="10.937059684s" totalImagesPullingTime="7.531026291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:39.936837878 +0000 UTC m=+10.659558296" watchObservedRunningTime="2026-10-30 23:34:39.937059684 +0000 UTC m=+10.659780097" Oct 30 23:34:39.990802 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:39.990762 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-kh84m" podStartSLOduration=2.347678945 podStartE2EDuration="9.990749548s" totalImagesPullingTime="7.643070603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:39.990232324 +0000 UTC m=+10.712952746" watchObservedRunningTime="2026-10-30 23:34:39.990749548 +0000 UTC m=+10.713469966" Oct 30 23:34:40.892904 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:40.892688 2576 generic.go:356] "Generic (PLEG): container finished" podID="65fcac23-a536-479c-b515-28fbc7711990" containerID="e044245be40edb013c18c4a765ce0733f52524279f7fa2531af11cfeae2716fb" exitCode=0 Oct 30 23:34:40.893292 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:40.892952 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2g7g" event={"ID":"65fcac23-a536-479c-b515-28fbc7711990","Type":"ContainerDied","Data":"e044245be40edb013c18c4a765ce0733f52524279f7fa2531af11cfeae2716fb"} Oct 30 23:34:40.896414 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:40.896339 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9tldd" event={"ID":"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae","Type":"ContainerStarted","Data":"3565721330dd11ca76988f8f8f3e0b98b7e52ffccdca20f72d95bedc1db40b0a"} Oct 30 23:34:40.898914 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:40.898848 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" event={"ID":"4c7342b5-72f1-461d-8a00-eff0e377a4fe","Type":"ContainerStarted","Data":"119a246e1d94ef303ff8ce0df1443616367d7fb537120274a38471918af2e815"} Oct 30 23:34:41.049278 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:41.049222 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9tldd" podStartSLOduration=4.613122273 podStartE2EDuration="12.049204991s" totalImagesPullingTime="7.436082718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:41.001867542 +0000 UTC m=+11.724587961" watchObservedRunningTime="2026-10-30 23:34:41.049204991 +0000 UTC m=+11.771925412" Oct 30 23:34:41.049809 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:41.049766 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" podStartSLOduration=2.959059354 podStartE2EDuration="11.049753135s" totalImagesPullingTime="8.090693781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:41.048908642 +0000 UTC m=+11.771629063" watchObservedRunningTime="2026-10-30 23:34:41.049753135 +0000 UTC m=+11.772473559" Oct 30 23:34:41.673299 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:41.673274 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:41.673433 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:41.673391 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rjct" podUID="3e87ca45-ff16-44e3-a360-5252e624f610" Oct 30 23:34:41.673703 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:41.673679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:41.673772 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:41.673711 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:41.673899 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:41.673881 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cf6r4" podUID="969fd947-a81d-4e6a-b369-550efce8f665" Oct 30 23:34:41.673997 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:41.673978 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqgch" podUID="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" Oct 30 23:34:41.903650 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:41.903615 2576 generic.go:356] "Generic (PLEG): container finished" podID="65fcac23-a536-479c-b515-28fbc7711990" containerID="09c797f3e573ff1d21b4e514245525f049be47f14dd7bb62171d97372d0f41f1" exitCode=0 Oct 30 23:34:41.904364 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:41.903704 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2g7g" event={"ID":"65fcac23-a536-479c-b515-28fbc7711990","Type":"ContainerDied","Data":"09c797f3e573ff1d21b4e514245525f049be47f14dd7bb62171d97372d0f41f1"} Oct 30 23:34:41.908985 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:41.908884 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" event={"ID":"8b2eb3ea-17b1-4cec-ab47-27be6876bf69","Type":"ContainerStarted","Data":"6a3a1eb8ed6430eaec5bc86f4ed3d610089e6ff786625eba2615a8da58194e96"} Oct 30 23:34:42.013319 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:42.013274 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" podStartSLOduration=3.470041289 podStartE2EDuration="13.013260708s" totalImagesPullingTime="9.543219419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:42.012807808 +0000 UTC m=+12.735528226" watchObservedRunningTime="2026-10-30 23:34:42.013260708 +0000 UTC m=+12.735981128" Oct 30 23:34:42.913433 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:42.913400 2576 generic.go:356] "Generic (PLEG): container finished" podID="65fcac23-a536-479c-b515-28fbc7711990" containerID="da5c0d508e6016124885542b192fa75614ba4fd847e28ee63c88ed5ed7add294" exitCode=0 Oct 30 23:34:42.913927 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:42.913522 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2g7g" event={"ID":"65fcac23-a536-479c-b515-28fbc7711990","Type":"ContainerDied","Data":"da5c0d508e6016124885542b192fa75614ba4fd847e28ee63c88ed5ed7add294"} Oct 30 23:34:43.670331 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:43.670301 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:43.670499 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:43.670372 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:43.670499 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:43.670381 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:43.670499 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:43.670479 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqgch" podUID="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" Oct 30 23:34:43.670666 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:43.670582 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cf6r4" podUID="969fd947-a81d-4e6a-b369-550efce8f665" Oct 30 23:34:43.670713 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:43.670662 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rjct" podUID="3e87ca45-ff16-44e3-a360-5252e624f610" Oct 30 23:34:44.921548 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:44.921256 2576 generic.go:356] "Generic (PLEG): container finished" podID="65fcac23-a536-479c-b515-28fbc7711990" containerID="ea2b24f1e4239484b244f9a622ebe8ddc4aefc2d68ff990e096d52fb48173daf" exitCode=0 Oct 30 23:34:44.921548 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:44.921334 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2g7g" event={"ID":"65fcac23-a536-479c-b515-28fbc7711990","Type":"ContainerDied","Data":"ea2b24f1e4239484b244f9a622ebe8ddc4aefc2d68ff990e096d52fb48173daf"} Oct 30 23:34:45.670153 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:45.670121 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:45.670153 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:45.670144 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:45.670402 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:45.670253 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cf6r4" podUID="969fd947-a81d-4e6a-b369-550efce8f665" Oct 30 23:34:45.670402 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:45.670300 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rjct" podUID="3e87ca45-ff16-44e3-a360-5252e624f610" Oct 30 23:34:45.670402 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:45.670346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:45.670554 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:45.670433 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqgch" podUID="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" Oct 30 23:34:45.926538 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:45.926466 2576 generic.go:356] "Generic (PLEG): container finished" podID="65fcac23-a536-479c-b515-28fbc7711990" containerID="4522c44acac5872d8d38202e226bfaaca76f303d5e976f5ba76687b76dce4eb7" exitCode=0 Oct 30 23:34:45.926538 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:45.926504 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2g7g" event={"ID":"65fcac23-a536-479c-b515-28fbc7711990","Type":"ContainerDied","Data":"4522c44acac5872d8d38202e226bfaaca76f303d5e976f5ba76687b76dce4eb7"} Oct 30 23:34:46.932017 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:46.931822 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2g7g" event={"ID":"65fcac23-a536-479c-b515-28fbc7711990","Type":"ContainerStarted","Data":"a57ad0a46761c9130a0febd7e17ccab81e1d0a73f376d1899733ca2e784785f0"} Oct 30 23:34:46.934962 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:46.934936 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" event={"ID":"931f746a-9d07-400d-9b4c-c16569e47a38","Type":"ContainerStarted","Data":"64e2e0043b4a9541d65aa0f784320c4a6440f0bdda6ea4efe8a6af1a9f6b0bb4"} Oct 30 23:34:46.935102 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:46.934995 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" event={"ID":"931f746a-9d07-400d-9b4c-c16569e47a38","Type":"ContainerStarted","Data":"7c1d1a92f8e1df2a33efc3f091cca2279da37e69e922f27552e13bfa96b0394c"} Oct 30 23:34:46.935102 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:46.935027 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" event={"ID":"931f746a-9d07-400d-9b4c-c16569e47a38","Type":"ContainerStarted","Data":"3bdbb0bcecb4255b6fca2d7020116d48b7af04df3dff31ecebfec08afa614714"} Oct 30 23:34:46.935102 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:46.935068 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" event={"ID":"931f746a-9d07-400d-9b4c-c16569e47a38","Type":"ContainerStarted","Data":"59ba11b41b1959694234f712b058b0ecf36ae26a554e938151ecb083154b3d71"} Oct 30 23:34:46.935102 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:46.935097 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" event={"ID":"931f746a-9d07-400d-9b4c-c16569e47a38","Type":"ContainerStarted","Data":"6df3d9d23a32279f4d13a692af3ec81adb10989edbdf4bf4d62f8d4dceaa3fa0"} Oct 30 23:34:46.935243 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:46.935125 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" event={"ID":"931f746a-9d07-400d-9b4c-c16569e47a38","Type":"ContainerStarted","Data":"d1aa145131072d765ce88d534fec0a616c59490653d54bcdc6e8a9af3ad2fbe5"} Oct 30 23:34:46.973961 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:46.973890 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t2g7g" podStartSLOduration=8.254042896 podStartE2EDuration="17.973879244s" totalImagesPullingTime="9.719836348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:46.972969737 +0000 UTC m=+17.695690156" watchObservedRunningTime="2026-10-30 23:34:46.973879244 +0000 UTC m=+17.696599663" Oct 30 23:34:47.448276 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:47.448247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:47.448392 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:47.448339 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:47.448392 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:47.448390 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret podName:4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:03.448376439 +0000 UTC m=+34.171096835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret") pod "global-pull-secret-syncer-bqgch" (UID: "4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91") : object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:47.548672 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:47.548639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb9b4\" (UniqueName: \"kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4\") pod \"network-check-target-2rjct\" (UID: \"3e87ca45-ff16-44e3-a360-5252e624f610\") " pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:47.548840 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:47.548676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:47.548840 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:47.548783 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:47.548840 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:47.548789 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 23:34:47.548840 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:47.548809 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 23:34:47.548840 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:47.548819 2576 projected.go:196] Error preparing data for projected volume kube-api-access-xb9b4 for pod openshift-network-diagnostics/network-check-target-2rjct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:47.548840 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:47.548843 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs podName:969fd947-a81d-4e6a-b369-550efce8f665 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:03.548827957 +0000 UTC m=+34.271548369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs") pod "network-metrics-daemon-cf6r4" (UID: "969fd947-a81d-4e6a-b369-550efce8f665") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:47.549171 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:47.548863 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4 podName:3e87ca45-ff16-44e3-a360-5252e624f610 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:03.548853132 +0000 UTC m=+34.271573536 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xb9b4" (UniqueName: "kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4") pod "network-check-target-2rjct" (UID: "3e87ca45-ff16-44e3-a360-5252e624f610") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:47.670302 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:47.670280 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:47.670302 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:47.670295 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:47.670440 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:47.670421 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:47.670489 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:47.670424 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rjct" podUID="3e87ca45-ff16-44e3-a360-5252e624f610" Oct 30 23:34:47.670567 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:47.670548 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cf6r4" podUID="969fd947-a81d-4e6a-b369-550efce8f665" Oct 30 23:34:47.670647 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:47.670626 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqgch" podUID="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" Oct 30 23:34:48.941188 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:48.941159 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" event={"ID":"931f746a-9d07-400d-9b4c-c16569e47a38","Type":"ContainerStarted","Data":"105dac3b54826801dc82db007ba03bf34f5dc0f67bee5a9668c5be1aca452918"} Oct 30 23:34:49.673517 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:49.672217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:49.673517 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:49.672408 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cf6r4" podUID="969fd947-a81d-4e6a-b369-550efce8f665" Oct 30 23:34:49.673517 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:49.672910 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:49.673517 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:49.673083 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqgch" podUID="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" Oct 30 23:34:49.673517 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:49.673156 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:49.673517 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:49.673265 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rjct" podUID="3e87ca45-ff16-44e3-a360-5252e624f610" Oct 30 23:34:50.948422 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:50.948385 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" event={"ID":"931f746a-9d07-400d-9b4c-c16569e47a38","Type":"ContainerStarted","Data":"25658f3bd4e92b65aa29e8a992377a85bd9e7f1e6754f51145f5f04b6d05cc92"} Oct 30 23:34:50.949096 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:50.948784 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:50.949096 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:50.948857 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:50.964250 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:50.964224 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:50.964882 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:50.964862 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:51.034597 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:51.034554 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" podStartSLOduration=6.631778559 podStartE2EDuration="21.03454002s" totalImagesPullingTime="14.402761461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:51.021402928 +0000 UTC m=+21.744123347" watchObservedRunningTime="2026-10-30 23:34:51.03454002 +0000 UTC m=+21.757260439" Oct 30 23:34:51.670316 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:51.670289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:51.670448 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:51.670314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:51.670448 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:51.670381 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqgch" podUID="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" Oct 30 23:34:51.670448 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:51.670419 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:51.670550 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:51.670503 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rjct" podUID="3e87ca45-ff16-44e3-a360-5252e624f610" Oct 30 23:34:51.670607 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:51.670589 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cf6r4" podUID="969fd947-a81d-4e6a-b369-550efce8f665" Oct 30 23:34:51.951034 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:51.950969 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 23:34:52.953505 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:52.953482 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 23:34:52.960957 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:52.960932 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bqgch"] Oct 30 23:34:52.961094 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:52.961024 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:52.961164 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:52.961139 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqgch" podUID="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" Oct 30 23:34:52.964166 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:52.964142 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2rjct"] Oct 30 23:34:52.964277 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:52.964224 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:52.964316 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:52.964292 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rjct" podUID="3e87ca45-ff16-44e3-a360-5252e624f610" Oct 30 23:34:52.973241 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:52.973221 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cf6r4"] Oct 30 23:34:52.973335 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:52.973288 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:52.973382 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:52.973358 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cf6r4" podUID="969fd947-a81d-4e6a-b369-550efce8f665" Oct 30 23:34:54.670598 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:54.670558 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:54.670598 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:54.670597 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:54.671206 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:54.670598 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:54.671206 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:54.670705 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cf6r4" podUID="969fd947-a81d-4e6a-b369-550efce8f665" Oct 30 23:34:54.671206 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:54.670774 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqgch" podUID="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" Oct 30 23:34:54.671206 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:54.670847 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rjct" podUID="3e87ca45-ff16-44e3-a360-5252e624f610" Oct 30 23:34:56.670291 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:56.670088 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:56.670676 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:56.670111 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:56.670676 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:56.670359 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqgch" podUID="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" Oct 30 23:34:56.670676 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:56.670445 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rjct" podUID="3e87ca45-ff16-44e3-a360-5252e624f610" Oct 30 23:34:56.670676 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:56.670169 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:56.670676 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:56.670532 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cf6r4" podUID="969fd947-a81d-4e6a-b369-550efce8f665" Oct 30 23:34:58.669687 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:58.669623 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:34:58.670157 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:58.669623 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:34:58.670157 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:58.669710 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqgch" podUID="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" Oct 30 23:34:58.670157 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:58.669623 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:34:58.670157 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:58.669793 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cf6r4" podUID="969fd947-a81d-4e6a-b369-550efce8f665" Oct 30 23:34:58.670157 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:34:58.669871 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rjct" podUID="3e87ca45-ff16-44e3-a360-5252e624f610" Oct 30 23:34:59.147611 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:59.147580 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:34:59.147773 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:59.147755 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 23:34:59.148193 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:59.148168 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:34:59.873929 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:59.873908 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:34:59.874289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:59.874134 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 23:34:59.889010 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:34:59.888991 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:00.081739 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.081721 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeReady" Oct 30 23:35:00.081833 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.081811 2576 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 30 23:35:00.131090 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.131015 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7"] Oct 30 23:35:00.196018 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.195988 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-m926q"] Oct 30 23:35:00.196490 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.196473 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:00.211589 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.211569 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Oct 30 23:35:00.211684 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.211589 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:00.211684 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.211603 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Oct 30 23:35:00.211684 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.211612 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Oct 30 23:35:00.211782 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.211759 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v2jrp\"" Oct 30 23:35:00.216205 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.216191 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6"] Oct 30 23:35:00.216308 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.216296 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-m926q" Oct 30 23:35:00.230238 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.230222 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-7z66c"] Oct 30 23:35:00.230360 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.230346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:00.237677 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.237661 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Oct 30 23:35:00.243351 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.243335 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-958pp"] Oct 30 23:35:00.243449 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.243434 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-7z66c" Oct 30 23:35:00.259631 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.259616 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-dwmwv"] Oct 30 23:35:00.259750 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.259619 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:00.280942 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.280924 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b5577b589-v98nd"] Oct 30 23:35:00.281022 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.281002 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.297113 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.297097 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8"] Oct 30 23:35:00.297203 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.297195 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:00.311944 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.311928 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Oct 30 23:35:00.312021 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.311981 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Oct 30 23:35:00.312021 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.311989 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Oct 30 23:35:00.312021 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.312003 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mgh6h\"" Oct 30 23:35:00.312021 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.312019 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dplzz\"" Oct 30 23:35:00.312159 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.312074 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xjgj5\"" Oct 30 23:35:00.312227 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.312213 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Oct 30 23:35:00.312331 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.312317 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Oct 30 23:35:00.312419 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.312408 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Oct 30 23:35:00.312510 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.312499 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9bbrw\"" Oct 30 23:35:00.312827 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.312814 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 23:35:00.312872 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.312860 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:00.312901 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.312874 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Oct 30 23:35:00.312901 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.312875 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 23:35:00.312962 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.312874 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Oct 30 23:35:00.312962 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.312915 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 23:35:00.313020 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.313010 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 23:35:00.313081 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.313063 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Oct 30 23:35:00.313180 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.313144 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 23:35:00.313212 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.313171 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Oct 30 23:35:00.313289 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.313276 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 30 23:35:00.316610 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.316598 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-865f789994-pzwps"] Oct 30 23:35:00.316708 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.316696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:00.323053 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.323010 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 30 23:35:00.324555 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.324543 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Oct 30 23:35:00.327467 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.327452 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 23:35:00.327552 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.327470 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Oct 30 23:35:00.335391 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.335374 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Oct 30 23:35:00.335476 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.335432 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Oct 30 23:35:00.335542 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.335510 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-48l4h\"" Oct 30 23:35:00.337185 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.337171 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:00.337242 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.337211 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Oct 30 23:35:00.340737 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.340724 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-7mrn6"] Oct 30 23:35:00.340849 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.340835 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.343368 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.343349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkvqn\" (UniqueName: \"kubernetes.io/projected/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-kube-api-access-jkvqn\") pod \"service-ca-operator-544d749c8c-2ksc7\" (UID: \"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:00.343452 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.343384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s667\" (UniqueName: \"kubernetes.io/projected/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-kube-api-access-5s667\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:00.343494 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.343463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-config\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:00.343494 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.343488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-trusted-ca\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:00.343578 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.343509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78sng\" (UniqueName: \"kubernetes.io/projected/938e07e9-87b4-4618-87c0-b59bd13e7282-kube-api-access-78sng\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:00.343615 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.343594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-config\") pod \"service-ca-operator-544d749c8c-2ksc7\" (UID: \"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:00.343694 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.343678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:00.343758 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.343707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-serving-cert\") pod \"service-ca-operator-544d749c8c-2ksc7\" (UID: \"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:00.343811 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.343770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/938e07e9-87b4-4618-87c0-b59bd13e7282-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:00.343811 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.343804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz7nv\" (UniqueName: \"kubernetes.io/projected/72875bb8-4630-4ff6-bda6-19710347ae74-kube-api-access-xz7nv\") pod \"kas-connection-checker-685895c7c9-m926q\" (UID: \"72875bb8-4630-4ff6-bda6-19710347ae74\") " pod="kube-system/kas-connection-checker-685895c7c9-m926q" Oct 30 23:35:00.343886 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.343860 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rvsv\" (UniqueName: \"kubernetes.io/projected/00f615e4-f815-49c8-b68d-23a95bc98a10-kube-api-access-8rvsv\") pod \"kas-connection-checker-685895c7c9-7z66c\" (UID: \"00f615e4-f815-49c8-b68d-23a95bc98a10\") " pod="kube-system/kas-connection-checker-685895c7c9-7z66c" Oct 30 23:35:00.343886 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.343880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-serving-cert\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:00.360439 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.360423 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-mbbk5"] Oct 30 23:35:00.360516 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.360496 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:00.383784 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.383746 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns"] Oct 30 23:35:00.383881 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.383870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-mbbk5" Oct 30 23:35:00.406486 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.406464 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cht6c"] Oct 30 23:35:00.406581 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.406566 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:00.412135 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.412118 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 30 23:35:00.412234 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.412220 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Oct 30 23:35:00.412426 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.412402 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 30 23:35:00.412478 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.412429 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z4ngs\"" Oct 30 23:35:00.412587 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.412550 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Oct 30 23:35:00.412788 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.412745 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-p5ttc\"" Oct 30 23:35:00.412840 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.412809 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 30 23:35:00.413057 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.413030 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 30 23:35:00.422057 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.422025 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:00.422651 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.422633 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Oct 30 23:35:00.422770 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.422758 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qhlbv\"" Oct 30 23:35:00.422820 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.422810 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Oct 30 23:35:00.422857 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.422811 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Oct 30 23:35:00.432724 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.432705 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-cgrj8"] Oct 30 23:35:00.432814 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.432800 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cht6c" Oct 30 23:35:00.444275 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444254 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7nv\" (UniqueName: \"kubernetes.io/projected/72875bb8-4630-4ff6-bda6-19710347ae74-kube-api-access-xz7nv\") pod \"kas-connection-checker-685895c7c9-m926q\" (UID: \"72875bb8-4630-4ff6-bda6-19710347ae74\") " pod="kube-system/kas-connection-checker-685895c7c9-m926q" Oct 30 23:35:00.444354 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-serving-cert\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:00.444354 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-bound-sa-token\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.444354 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444321 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1302dd34-a67e-4861-96d8-1b98c2d2e314-nginx-conf\") pod \"networking-console-plugin-86c478bb88-7mrn6\" (UID: \"1302dd34-a67e-4861-96d8-1b98c2d2e314\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:00.444354 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkvqn\" (UniqueName: \"kubernetes.io/projected/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-kube-api-access-jkvqn\") pod \"service-ca-operator-544d749c8c-2ksc7\" (UID: \"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:00.444495 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444482 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-registry-certificates\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.444536 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-config\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:00.444571 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444547 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4pbv\" (UniqueName: \"kubernetes.io/projected/9cb59a65-5d33-4842-abe0-582372433b12-kube-api-access-h4pbv\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.444603 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-trusted-ca\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:00.444640 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:00.444714 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjs9k\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-kube-api-access-gjs9k\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.444750 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78sng\" (UniqueName: \"kubernetes.io/projected/938e07e9-87b4-4618-87c0-b59bd13e7282-kube-api-access-78sng\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:00.444827 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-default-certificate\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:00.444885 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-7mrn6\" (UID: \"1302dd34-a67e-4861-96d8-1b98c2d2e314\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:00.444939 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:00.444995 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-serving-cert\") pod \"service-ca-operator-544d749c8c-2ksc7\" (UID: \"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:00.444995 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/05a8da7c-7313-471b-8437-fff42cdbda65-ca-trust-extracted\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.445105 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.444998 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:00.445105 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rvsv\" (UniqueName: \"kubernetes.io/projected/00f615e4-f815-49c8-b68d-23a95bc98a10-kube-api-access-8rvsv\") pod \"kas-connection-checker-685895c7c9-7z66c\" (UID: \"00f615e4-f815-49c8-b68d-23a95bc98a10\") " pod="kube-system/kas-connection-checker-685895c7c9-7z66c" Oct 30 23:35:00.445208 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9cb59a65-5d33-4842-abe0-582372433b12-snapshots\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.445208 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445175 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-config\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:00.445208 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-stats-auth\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:00.445350 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s667\" (UniqueName: \"kubernetes.io/projected/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-kube-api-access-5s667\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:00.445398 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-image-registry-private-configuration\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.445398 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445376 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-trusted-ca\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:00.445482 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cb59a65-5d33-4842-abe0-582372433b12-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.445519 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445482 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cb59a65-5d33-4842-abe0-582372433b12-service-ca-bundle\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.445519 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-installation-pull-secrets\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.445582 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9cb59a65-5d33-4842-abe0-582372433b12-serving-cert\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.445582 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:00.445651 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-trusted-ca\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.445651 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkbtl\" (UniqueName: \"kubernetes.io/projected/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-kube-api-access-fkbtl\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:00.445713 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-config\") pod \"service-ca-operator-544d749c8c-2ksc7\" (UID: \"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:00.445713 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6trgt\" (UniqueName: \"kubernetes.io/projected/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-kube-api-access-6trgt\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:00.445789 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:00.445789 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cb59a65-5d33-4842-abe0-582372433b12-tmp\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.445871 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.445912 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.445876 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 23:35:00.445912 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.445896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/938e07e9-87b4-4618-87c0-b59bd13e7282-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:00.445912 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.445911 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls podName:938e07e9-87b4-4618-87c0-b59bd13e7282 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:00.945900481 +0000 UTC m=+31.668620879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-sc2z6" (UID: "938e07e9-87b4-4618-87c0-b59bd13e7282") : secret "cluster-monitoring-operator-tls" not found Oct 30 23:35:00.446358 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.446336 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-config\") pod \"service-ca-operator-544d749c8c-2ksc7\" (UID: \"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:00.446520 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.446505 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/938e07e9-87b4-4618-87c0-b59bd13e7282-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:00.446864 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.446852 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6749d98767-f4mjs"] Oct 30 23:35:00.446961 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.446949 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-cgrj8" Oct 30 23:35:00.448376 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.448352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-serving-cert\") pod \"service-ca-operator-544d749c8c-2ksc7\" (UID: \"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:00.448447 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.448376 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-serving-cert\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:00.467624 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.467600 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rvsv\" (UniqueName: \"kubernetes.io/projected/00f615e4-f815-49c8-b68d-23a95bc98a10-kube-api-access-8rvsv\") pod \"kas-connection-checker-685895c7c9-7z66c\" (UID: \"00f615e4-f815-49c8-b68d-23a95bc98a10\") " pod="kube-system/kas-connection-checker-685895c7c9-7z66c" Oct 30 23:35:00.467699 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.467674 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz7nv\" (UniqueName: \"kubernetes.io/projected/72875bb8-4630-4ff6-bda6-19710347ae74-kube-api-access-xz7nv\") pod \"kas-connection-checker-685895c7c9-m926q\" (UID: \"72875bb8-4630-4ff6-bda6-19710347ae74\") " pod="kube-system/kas-connection-checker-685895c7c9-m926q" Oct 30 23:35:00.467868 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.467852 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkvqn\" (UniqueName: \"kubernetes.io/projected/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-kube-api-access-jkvqn\") pod \"service-ca-operator-544d749c8c-2ksc7\" (UID: \"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:00.468087 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.468065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78sng\" (UniqueName: \"kubernetes.io/projected/938e07e9-87b4-4618-87c0-b59bd13e7282-kube-api-access-78sng\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:00.468687 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.468665 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s667\" (UniqueName: \"kubernetes.io/projected/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-kube-api-access-5s667\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:00.483727 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.483711 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7"] Oct 30 23:35:00.483820 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.483737 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-m926q"] Oct 30 23:35:00.483820 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.483755 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6"] Oct 30 23:35:00.483820 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.483784 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m5ssb"] Oct 30 23:35:00.483922 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.483881 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.505663 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.505644 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qpgjl"] Oct 30 23:35:00.505761 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.505747 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m5ssb" Oct 30 23:35:00.512592 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.512571 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 23:35:00.512673 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.512624 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Oct 30 23:35:00.512727 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.512708 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 23:35:00.512785 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.512772 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:00.512818 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.512782 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vznwb\"" Oct 30 23:35:00.512849 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.512810 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-jb9z2\"" Oct 30 23:35:00.520089 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520074 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8"] Oct 30 23:35:00.520182 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520110 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-958pp"] Oct 30 23:35:00.520182 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520127 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-dwmwv"] Oct 30 23:35:00.520182 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520139 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-mbbk5"] Oct 30 23:35:00.520182 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520152 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b5577b589-v98nd"] Oct 30 23:35:00.520182 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520171 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 23:35:00.520346 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520176 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-865f789994-pzwps"] Oct 30 23:35:00.520346 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520200 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:00.520346 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520226 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns"] Oct 30 23:35:00.520346 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520250 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 23:35:00.520346 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520254 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-7z66c"] Oct 30 23:35:00.520346 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520264 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 23:35:00.520346 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520276 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m5ssb"] Oct 30 23:35:00.520346 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520298 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-cgrj8"] Oct 30 23:35:00.520346 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520317 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-7mrn6"] Oct 30 23:35:00.520346 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520336 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qpgjl"] Oct 30 23:35:00.520346 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520348 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-rvj77\"" Oct 30 23:35:00.520636 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520360 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cht6c"] Oct 30 23:35:00.520636 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.520382 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6749d98767-f4mjs"] Oct 30 23:35:00.524678 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.524664 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:00.535484 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.535469 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dqbbs\"" Oct 30 23:35:00.540051 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.540027 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-m926q" Oct 30 23:35:00.546288 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.546266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cb59a65-5d33-4842-abe0-582372433b12-service-ca-bundle\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.546371 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.546295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-installation-pull-secrets\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.546371 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.546314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9cb59a65-5d33-4842-abe0-582372433b12-serving-cert\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.546371 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.546332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:00.546371 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.546361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-trusted-ca\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.546563 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.546384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkbtl\" (UniqueName: \"kubernetes.io/projected/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-kube-api-access-fkbtl\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:00.546563 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.546446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6trgt\" (UniqueName: \"kubernetes.io/projected/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-kube-api-access-6trgt\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:00.546563 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.546494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cb59a65-5d33-4842-abe0-582372433b12-tmp\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.546563 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.546516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.546902 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.546882 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:00.546902 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.546903 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865f789994-pzwps: secret "image-registry-tls" not found Oct 30 23:35:00.547122 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.546911 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cb59a65-5d33-4842-abe0-582372433b12-tmp\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.547122 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.546911 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cb59a65-5d33-4842-abe0-582372433b12-service-ca-bundle\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.547122 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.546990 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls podName:05a8da7c-7313-471b-8437-fff42cdbda65 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:01.046968831 +0000 UTC m=+31.769689235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls") pod "image-registry-865f789994-pzwps" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65") : secret "image-registry-tls" not found Oct 30 23:35:00.547122 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85f5885d-de4d-472f-aa8e-036454ea9a4d-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-7plns\" (UID: \"85f5885d-de4d-472f-aa8e-036454ea9a4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:00.547122 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547062 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:00.547122 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-bound-sa-token\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.547430 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1302dd34-a67e-4861-96d8-1b98c2d2e314-nginx-conf\") pod \"networking-console-plugin-86c478bb88-7mrn6\" (UID: \"1302dd34-a67e-4861-96d8-1b98c2d2e314\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:00.547430 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547193 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-registry-certificates\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.547430 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbtd2\" (UniqueName: \"kubernetes.io/projected/f2ba63b6-5f40-4d47-9b46-ec9f8888edce-kube-api-access-zbtd2\") pod \"volume-data-source-validator-58c9f5f46d-cht6c\" (UID: \"f2ba63b6-5f40-4d47-9b46-ec9f8888edce\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cht6c" Oct 30 23:35:00.547430 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4pbv\" (UniqueName: \"kubernetes.io/projected/9cb59a65-5d33-4842-abe0-582372433b12-kube-api-access-h4pbv\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.547430 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547287 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:00.547430 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjs9k\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-kube-api-access-gjs9k\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.547430 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-default-certificate\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:00.547430 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-7mrn6\" (UID: \"1302dd34-a67e-4861-96d8-1b98c2d2e314\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:00.547430 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85f5885d-de4d-472f-aa8e-036454ea9a4d-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-7plns\" (UID: \"85f5885d-de4d-472f-aa8e-036454ea9a4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:00.547430 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:00.547889 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plhfv\" (UniqueName: \"kubernetes.io/projected/fcf08154-6f21-453e-9028-7377db286d04-kube-api-access-plhfv\") pod \"network-check-source-6f78d59f99-cgrj8\" (UID: \"fcf08154-6f21-453e-9028-7377db286d04\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-cgrj8" Oct 30 23:35:00.547889 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/05a8da7c-7313-471b-8437-fff42cdbda65-ca-trust-extracted\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.547889 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:00.547889 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9cb59a65-5d33-4842-abe0-582372433b12-snapshots\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.547889 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-stats-auth\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:00.547889 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.547674 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-trusted-ca\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.548192 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.547993 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 23:35:00.548192 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.548056 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs podName:f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:01.048025286 +0000 UTC m=+31.770745707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs") pod "router-default-5b5577b589-v98nd" (UID: "f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4") : secret "router-metrics-certs-default" not found Oct 30 23:35:00.548192 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.548114 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-registry-certificates\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.548351 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.548201 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 23:35:00.548351 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.548247 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls podName:a89e6ed3-bb09-4d7f-85cb-092cd129b7bb nodeName:}" failed. No retries permitted until 2026-10-30 23:35:01.048230509 +0000 UTC m=+31.770950924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-87pc8" (UID: "a89e6ed3-bb09-4d7f-85cb-092cd129b7bb") : secret "samples-operator-tls" not found Oct 30 23:35:00.548541 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.548395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mfwz\" (UniqueName: \"kubernetes.io/projected/85f5885d-de4d-472f-aa8e-036454ea9a4d-kube-api-access-6mfwz\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-7plns\" (UID: \"85f5885d-de4d-472f-aa8e-036454ea9a4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:00.548541 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.548444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-image-registry-private-configuration\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.548541 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.548472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rknsh\" (UniqueName: \"kubernetes.io/projected/ad6a30fe-07fa-48aa-92c3-4289c1066b37-kube-api-access-rknsh\") pod \"kas-connection-checker-685895c7c9-mbbk5\" (UID: \"ad6a30fe-07fa-48aa-92c3-4289c1066b37\") " pod="kube-system/kas-connection-checker-685895c7c9-mbbk5" Oct 30 23:35:00.548541 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.548494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cb59a65-5d33-4842-abe0-582372433b12-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.548541 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.548501 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 23:35:00.548767 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.548573 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert podName:1302dd34-a67e-4861-96d8-1b98c2d2e314 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:01.048558367 +0000 UTC m=+31.771278781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-7mrn6" (UID: "1302dd34-a67e-4861-96d8-1b98c2d2e314") : secret "networking-console-plugin-cert" not found Oct 30 23:35:00.548767 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.548632 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle podName:f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:01.048609908 +0000 UTC m=+31.771330324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle") pod "router-default-5b5577b589-v98nd" (UID: "f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4") : configmap references non-existent config key: service-ca.crt Oct 30 23:35:00.548767 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.548697 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1302dd34-a67e-4861-96d8-1b98c2d2e314-nginx-conf\") pod \"networking-console-plugin-86c478bb88-7mrn6\" (UID: \"1302dd34-a67e-4861-96d8-1b98c2d2e314\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:00.548913 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.548828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9cb59a65-5d33-4842-abe0-582372433b12-serving-cert\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.549019 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.548999 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9cb59a65-5d33-4842-abe0-582372433b12-snapshots\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.549195 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.549146 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/05a8da7c-7313-471b-8437-fff42cdbda65-ca-trust-extracted\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.549656 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.549597 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-installation-pull-secrets\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.549740 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.549672 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cb59a65-5d33-4842-abe0-582372433b12-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.551225 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.551190 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-stats-auth\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:00.551412 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.551395 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-default-certificate\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:00.551668 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.551635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-image-registry-private-configuration\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.567052 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.567018 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6trgt\" (UniqueName: \"kubernetes.io/projected/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-kube-api-access-6trgt\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:00.567132 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.567034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkbtl\" (UniqueName: \"kubernetes.io/projected/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-kube-api-access-fkbtl\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:00.567632 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.567617 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjs9k\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-kube-api-access-gjs9k\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.568331 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.568314 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4pbv\" (UniqueName: \"kubernetes.io/projected/9cb59a65-5d33-4842-abe0-582372433b12-kube-api-access-h4pbv\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.576523 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.576497 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-bound-sa-token\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:00.591720 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.591701 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-7z66c" Oct 30 23:35:00.610777 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.610410 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:00.613205 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.613080 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 23:35:00.613205 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.613171 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 23:35:00.650731 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.650375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rknsh\" (UniqueName: \"kubernetes.io/projected/ad6a30fe-07fa-48aa-92c3-4289c1066b37-kube-api-access-rknsh\") pod \"kas-connection-checker-685895c7c9-mbbk5\" (UID: \"ad6a30fe-07fa-48aa-92c3-4289c1066b37\") " pod="kube-system/kas-connection-checker-685895c7c9-mbbk5" Oct 30 23:35:00.650731 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.650423 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-bound-sa-token\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.650731 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.650457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5-cert\") pod \"ingress-canary-m5ssb\" (UID: \"55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5\") " pod="openshift-ingress-canary/ingress-canary-m5ssb" Oct 30 23:35:00.652184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.650489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-tmp-dir\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:00.652184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.650980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-trusted-ca\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.652184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.651024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-installation-pull-secrets\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.652184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.651146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2wdw\" (UniqueName: \"kubernetes.io/projected/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-kube-api-access-h2wdw\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:00.652184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.651223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpvhk\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-kube-api-access-gpvhk\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.652184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.651303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85f5885d-de4d-472f-aa8e-036454ea9a4d-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-7plns\" (UID: \"85f5885d-de4d-472f-aa8e-036454ea9a4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:00.652184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.651330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-certificates\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.652184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.651394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbtd2\" (UniqueName: \"kubernetes.io/projected/f2ba63b6-5f40-4d47-9b46-ec9f8888edce-kube-api-access-zbtd2\") pod \"volume-data-source-validator-58c9f5f46d-cht6c\" (UID: \"f2ba63b6-5f40-4d47-9b46-ec9f8888edce\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cht6c" Oct 30 23:35:00.652184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.651420 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f5051b3-19d4-422e-a8d1-47129e287d57-ca-trust-extracted\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.652184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.651489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.652184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.651572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85f5885d-de4d-472f-aa8e-036454ea9a4d-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-7plns\" (UID: \"85f5885d-de4d-472f-aa8e-036454ea9a4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:00.652184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.651635 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-image-registry-private-configuration\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.652184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.651682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhfv\" (UniqueName: \"kubernetes.io/projected/fcf08154-6f21-453e-9028-7377db286d04-kube-api-access-plhfv\") pod \"network-check-source-6f78d59f99-cgrj8\" (UID: \"fcf08154-6f21-453e-9028-7377db286d04\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-cgrj8" Oct 30 23:35:00.652184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.651704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:00.652184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.651747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-config-volume\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:00.653508 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.651791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27wgd\" (UniqueName: \"kubernetes.io/projected/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5-kube-api-access-27wgd\") pod \"ingress-canary-m5ssb\" (UID: \"55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5\") " pod="openshift-ingress-canary/ingress-canary-m5ssb" Oct 30 23:35:00.653508 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.651819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mfwz\" (UniqueName: \"kubernetes.io/projected/85f5885d-de4d-472f-aa8e-036454ea9a4d-kube-api-access-6mfwz\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-7plns\" (UID: \"85f5885d-de4d-472f-aa8e-036454ea9a4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:00.653508 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.652143 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85f5885d-de4d-472f-aa8e-036454ea9a4d-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-7plns\" (UID: \"85f5885d-de4d-472f-aa8e-036454ea9a4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:00.653508 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.652562 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:00.655133 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.655104 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85f5885d-de4d-472f-aa8e-036454ea9a4d-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-7plns\" (UID: \"85f5885d-de4d-472f-aa8e-036454ea9a4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:00.669838 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.669639 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:35:00.678637 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.678609 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rknsh\" (UniqueName: \"kubernetes.io/projected/ad6a30fe-07fa-48aa-92c3-4289c1066b37-kube-api-access-rknsh\") pod \"kas-connection-checker-685895c7c9-mbbk5\" (UID: \"ad6a30fe-07fa-48aa-92c3-4289c1066b37\") " pod="kube-system/kas-connection-checker-685895c7c9-mbbk5" Oct 30 23:35:00.683367 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.679239 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbtd2\" (UniqueName: \"kubernetes.io/projected/f2ba63b6-5f40-4d47-9b46-ec9f8888edce-kube-api-access-zbtd2\") pod \"volume-data-source-validator-58c9f5f46d-cht6c\" (UID: \"f2ba63b6-5f40-4d47-9b46-ec9f8888edce\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cht6c" Oct 30 23:35:00.683367 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.679885 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plhfv\" (UniqueName: \"kubernetes.io/projected/fcf08154-6f21-453e-9028-7377db286d04-kube-api-access-plhfv\") pod \"network-check-source-6f78d59f99-cgrj8\" (UID: \"fcf08154-6f21-453e-9028-7377db286d04\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-cgrj8" Oct 30 23:35:00.683367 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.680314 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mfwz\" (UniqueName: \"kubernetes.io/projected/85f5885d-de4d-472f-aa8e-036454ea9a4d-kube-api-access-6mfwz\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-7plns\" (UID: \"85f5885d-de4d-472f-aa8e-036454ea9a4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:00.683367 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.680753 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:35:00.683614 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.683412 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:35:00.713918 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.713561 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-wj7js\"" Oct 30 23:35:00.713918 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.713704 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-p2ccw\"" Oct 30 23:35:00.713918 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.713761 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 23:35:00.713918 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.713847 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 23:35:00.714534 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.714469 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tzsrk\"" Oct 30 23:35:00.752399 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.752378 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-mbbk5" Oct 30 23:35:00.753652 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.753632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-tmp-dir\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:00.753810 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.753659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-trusted-ca\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.753810 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.753680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-installation-pull-secrets\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.753810 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.753700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2wdw\" (UniqueName: \"kubernetes.io/projected/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-kube-api-access-h2wdw\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:00.753810 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.753792 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpvhk\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-kube-api-access-gpvhk\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.754030 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.753863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-certificates\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.754030 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.753938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f5051b3-19d4-422e-a8d1-47129e287d57-ca-trust-extracted\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.754030 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.754002 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.754196 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.754069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-image-registry-private-configuration\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.754196 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.753950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-tmp-dir\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:00.754196 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.754121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:00.754196 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.754164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-config-volume\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:00.754196 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.754189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27wgd\" (UniqueName: \"kubernetes.io/projected/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5-kube-api-access-27wgd\") pod \"ingress-canary-m5ssb\" (UID: \"55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5\") " pod="openshift-ingress-canary/ingress-canary-m5ssb" Oct 30 23:35:00.754433 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.754223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-bound-sa-token\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.754433 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.754259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5-cert\") pod \"ingress-canary-m5ssb\" (UID: \"55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5\") " pod="openshift-ingress-canary/ingress-canary-m5ssb" Oct 30 23:35:00.754433 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.754396 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-certificates\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.754577 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.754438 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f5051b3-19d4-422e-a8d1-47129e287d57-ca-trust-extracted\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.754577 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.754545 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:00.754577 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.754560 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6749d98767-f4mjs: secret "image-registry-tls" not found Oct 30 23:35:00.754724 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.754624 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls podName:2f5051b3-19d4-422e-a8d1-47129e287d57 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:01.254602957 +0000 UTC m=+31.977323374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls") pod "image-registry-6749d98767-f4mjs" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57") : secret "image-registry-tls" not found Oct 30 23:35:00.754821 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.754789 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-trusted-ca\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.755147 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.754897 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-config-volume\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:00.755147 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.754964 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 23:35:00.755147 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.755123 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls podName:b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d nodeName:}" failed. No retries permitted until 2026-10-30 23:35:01.255106039 +0000 UTC m=+31.977826436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls") pod "dns-default-qpgjl" (UID: "b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d") : secret "dns-default-metrics-tls" not found Oct 30 23:35:00.756988 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.756958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-image-registry-private-configuration\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.757170 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.757152 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-installation-pull-secrets\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.758233 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.758214 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5-cert\") pod \"ingress-canary-m5ssb\" (UID: \"55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5\") " pod="openshift-ingress-canary/ingress-canary-m5ssb" Oct 30 23:35:00.772311 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.772288 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpvhk\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-kube-api-access-gpvhk\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.772405 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.772341 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2wdw\" (UniqueName: \"kubernetes.io/projected/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-kube-api-access-h2wdw\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:00.773258 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.773240 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-bound-sa-token\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:00.773775 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.773753 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27wgd\" (UniqueName: \"kubernetes.io/projected/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5-kube-api-access-27wgd\") pod \"ingress-canary-m5ssb\" (UID: \"55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5\") " pod="openshift-ingress-canary/ingress-canary-m5ssb" Oct 30 23:35:00.784317 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.784298 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cht6c" Oct 30 23:35:00.813919 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.813896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:00.891381 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.891237 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7"] Oct 30 23:35:00.894219 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.892672 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m5ssb" Oct 30 23:35:00.894219 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.893922 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-m926q"] Oct 30 23:35:00.908442 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:35:00.908419 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac81e307_c16f_4af8_bf87_f2c8bbaa8ab6.slice/crio-86137360f6a2b41e0a986d2cdff8c260694bd9c7099e54f0f20be50eb542409a WatchSource:0}: Error finding container 86137360f6a2b41e0a986d2cdff8c260694bd9c7099e54f0f20be50eb542409a: Status 404 returned error can't find the container with id 86137360f6a2b41e0a986d2cdff8c260694bd9c7099e54f0f20be50eb542409a Oct 30 23:35:00.909410 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:35:00.909389 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72875bb8_4630_4ff6_bda6_19710347ae74.slice/crio-2a3a085850fe8c9a0179990cf36c32cc65d86884f0fc4aa5f98929a2ed684272 WatchSource:0}: Error finding container 2a3a085850fe8c9a0179990cf36c32cc65d86884f0fc4aa5f98929a2ed684272: Status 404 returned error can't find the container with id 2a3a085850fe8c9a0179990cf36c32cc65d86884f0fc4aa5f98929a2ed684272 Oct 30 23:35:00.913034 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.913012 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-cgrj8" Oct 30 23:35:00.951181 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.945454 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-7z66c"] Oct 30 23:35:00.956130 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.956102 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-958pp"] Oct 30 23:35:00.958219 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.958192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:00.958382 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.958336 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 23:35:00.958433 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:00.958388 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls podName:938e07e9-87b4-4618-87c0-b59bd13e7282 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:01.958374731 +0000 UTC m=+32.681095144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-sc2z6" (UID: "938e07e9-87b4-4618-87c0-b59bd13e7282") : secret "cluster-monitoring-operator-tls" not found Oct 30 23:35:00.979184 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.978147 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-m926q" event={"ID":"72875bb8-4630-4ff6-bda6-19710347ae74","Type":"ContainerStarted","Data":"2a3a085850fe8c9a0179990cf36c32cc65d86884f0fc4aa5f98929a2ed684272"} Oct 30 23:35:00.982113 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.979686 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" event={"ID":"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6","Type":"ContainerStarted","Data":"86137360f6a2b41e0a986d2cdff8c260694bd9c7099e54f0f20be50eb542409a"} Oct 30 23:35:00.982113 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.981126 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" event={"ID":"707fcc17-c66a-458e-bcb5-8b3558dbe8c4","Type":"ContainerStarted","Data":"d4a9e0d78687e270dd440a298ac6acdcab977290d221bfabb06291bfef10d3fc"} Oct 30 23:35:00.984151 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.982960 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-7z66c" event={"ID":"00f615e4-f815-49c8-b68d-23a95bc98a10","Type":"ContainerStarted","Data":"413b62b43bb849fce927766daa429b4c9702cb7e609628bb717157daa0189716"} Oct 30 23:35:00.987973 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:00.987947 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-dwmwv"] Oct 30 23:35:01.052133 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.050391 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-mbbk5"] Oct 30 23:35:01.059928 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.059531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:01.059928 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.059595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-7mrn6\" (UID: \"1302dd34-a67e-4861-96d8-1b98c2d2e314\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:01.059928 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.059627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:01.059928 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.059671 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:01.059928 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.059762 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:01.059928 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.059901 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:01.059928 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.059913 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865f789994-pzwps: secret "image-registry-tls" not found Oct 30 23:35:01.060290 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.060135 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 23:35:01.060290 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.060198 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert podName:1302dd34-a67e-4861-96d8-1b98c2d2e314 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:02.060178556 +0000 UTC m=+32.782898971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-7mrn6" (UID: "1302dd34-a67e-4861-96d8-1b98c2d2e314") : secret "networking-console-plugin-cert" not found Oct 30 23:35:01.060579 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.060561 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 23:35:01.060704 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.060615 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs podName:f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:02.060599881 +0000 UTC m=+32.783320304 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs") pod "router-default-5b5577b589-v98nd" (UID: "f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4") : secret "router-metrics-certs-default" not found Oct 30 23:35:01.060704 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.060690 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle podName:f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:02.060679347 +0000 UTC m=+32.783399760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle") pod "router-default-5b5577b589-v98nd" (UID: "f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4") : configmap references non-existent config key: service-ca.crt Oct 30 23:35:01.060819 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.060749 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 23:35:01.060819 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.060782 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls podName:a89e6ed3-bb09-4d7f-85cb-092cd129b7bb nodeName:}" failed. No retries permitted until 2026-10-30 23:35:02.060772099 +0000 UTC m=+32.783492512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-87pc8" (UID: "a89e6ed3-bb09-4d7f-85cb-092cd129b7bb") : secret "samples-operator-tls" not found Oct 30 23:35:01.060993 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.060981 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls podName:05a8da7c-7313-471b-8437-fff42cdbda65 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:02.060971502 +0000 UTC m=+32.783691912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls") pod "image-registry-865f789994-pzwps" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65") : secret "image-registry-tls" not found Oct 30 23:35:01.061134 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:35:01.061106 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6a30fe_07fa_48aa_92c3_4289c1066b37.slice/crio-fbc486c04618ab8d8b45584221593e060c3b9990e60db607e14d20f5e010dcfd WatchSource:0}: Error finding container fbc486c04618ab8d8b45584221593e060c3b9990e60db607e14d20f5e010dcfd: Status 404 returned error can't find the container with id fbc486c04618ab8d8b45584221593e060c3b9990e60db607e14d20f5e010dcfd Oct 30 23:35:01.094715 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.094691 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cht6c"] Oct 30 23:35:01.101811 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:35:01.101781 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ba63b6_5f40_4d47_9b46_ec9f8888edce.slice/crio-04977361d04dc89e93e27500a98d6879ee53efaff153014b50899597ec2d3568 WatchSource:0}: Error finding container 04977361d04dc89e93e27500a98d6879ee53efaff153014b50899597ec2d3568: Status 404 returned error can't find the container with id 04977361d04dc89e93e27500a98d6879ee53efaff153014b50899597ec2d3568 Oct 30 23:35:01.128760 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.128732 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns"] Oct 30 23:35:01.131473 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:35:01.131450 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f5885d_de4d_472f_aa8e_036454ea9a4d.slice/crio-dac8de80811c6087e8cbdf9dba9d153ee108f1462b086ebb9de035c4ec95c3f3 WatchSource:0}: Error finding container dac8de80811c6087e8cbdf9dba9d153ee108f1462b086ebb9de035c4ec95c3f3: Status 404 returned error can't find the container with id dac8de80811c6087e8cbdf9dba9d153ee108f1462b086ebb9de035c4ec95c3f3 Oct 30 23:35:01.228932 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.228906 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m5ssb"] Oct 30 23:35:01.231268 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:35:01.231244 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a2d22b_ecf1_4974_b8d2_5827f9ee4ee5.slice/crio-953f4e5ecd17a6e4d752561f96e273c037c838cf3c1491814ec235fdb2c77f3f WatchSource:0}: Error finding container 953f4e5ecd17a6e4d752561f96e273c037c838cf3c1491814ec235fdb2c77f3f: Status 404 returned error can't find the container with id 953f4e5ecd17a6e4d752561f96e273c037c838cf3c1491814ec235fdb2c77f3f Oct 30 23:35:01.261381 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.261352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:01.261480 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.261411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:01.261534 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.261483 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:01.261534 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.261498 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6749d98767-f4mjs: secret "image-registry-tls" not found Oct 30 23:35:01.261609 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.261538 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls podName:2f5051b3-19d4-422e-a8d1-47129e287d57 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:02.261525128 +0000 UTC m=+32.984245556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls") pod "image-registry-6749d98767-f4mjs" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57") : secret "image-registry-tls" not found Oct 30 23:35:01.261609 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.261548 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 23:35:01.261609 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.261590 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls podName:b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d nodeName:}" failed. No retries permitted until 2026-10-30 23:35:02.26157723 +0000 UTC m=+32.984297628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls") pod "dns-default-qpgjl" (UID: "b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d") : secret "dns-default-metrics-tls" not found Oct 30 23:35:01.273500 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.273478 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-cgrj8"] Oct 30 23:35:01.276956 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:35:01.276932 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf08154_6f21_453e_9028_7377db286d04.slice/crio-be290f49992e373865600cc32716fd055e83321974a3ce47df76130085909b22 WatchSource:0}: Error finding container be290f49992e373865600cc32716fd055e83321974a3ce47df76130085909b22: Status 404 returned error can't find the container with id be290f49992e373865600cc32716fd055e83321974a3ce47df76130085909b22 Oct 30 23:35:01.970138 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.969341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:01.970138 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.969482 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 23:35:01.970138 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:01.969768 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls podName:938e07e9-87b4-4618-87c0-b59bd13e7282 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:03.969749242 +0000 UTC m=+34.692469655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-sc2z6" (UID: "938e07e9-87b4-4618-87c0-b59bd13e7282") : secret "cluster-monitoring-operator-tls" not found Oct 30 23:35:01.989784 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.989710 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m5ssb" event={"ID":"55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5","Type":"ContainerStarted","Data":"953f4e5ecd17a6e4d752561f96e273c037c838cf3c1491814ec235fdb2c77f3f"} Oct 30 23:35:01.992562 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.991885 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-mbbk5" event={"ID":"ad6a30fe-07fa-48aa-92c3-4289c1066b37","Type":"ContainerStarted","Data":"84e150f94714bf4de3a51937ac095708ee5e9b5eea864137fc9b02f162980ed7"} Oct 30 23:35:01.992562 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.991929 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-mbbk5" event={"ID":"ad6a30fe-07fa-48aa-92c3-4289c1066b37","Type":"ContainerStarted","Data":"fbc486c04618ab8d8b45584221593e060c3b9990e60db607e14d20f5e010dcfd"} Oct 30 23:35:01.995853 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.995429 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-7z66c" event={"ID":"00f615e4-f815-49c8-b68d-23a95bc98a10","Type":"ContainerStarted","Data":"dea43b7f0e623f3847bcc91cc4dedf1e8c54f2824ff1b1e020d5f5795e6a2604"} Oct 30 23:35:01.999982 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:01.999958 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-cgrj8" event={"ID":"fcf08154-6f21-453e-9028-7377db286d04","Type":"ContainerStarted","Data":"be290f49992e373865600cc32716fd055e83321974a3ce47df76130085909b22"} Oct 30 23:35:02.003136 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:02.003090 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" event={"ID":"85f5885d-de4d-472f-aa8e-036454ea9a4d","Type":"ContainerStarted","Data":"dac8de80811c6087e8cbdf9dba9d153ee108f1462b086ebb9de035c4ec95c3f3"} Oct 30 23:35:02.006941 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:02.006867 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cht6c" event={"ID":"f2ba63b6-5f40-4d47-9b46-ec9f8888edce","Type":"ContainerStarted","Data":"04977361d04dc89e93e27500a98d6879ee53efaff153014b50899597ec2d3568"} Oct 30 23:35:02.008923 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:02.008823 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-dwmwv" event={"ID":"9cb59a65-5d33-4842-abe0-582372433b12","Type":"ContainerStarted","Data":"625fac24fdc042c956394079d46035621497e8cf7f132603b125b141d4fa300a"} Oct 30 23:35:02.015558 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:02.015527 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-m926q" event={"ID":"72875bb8-4630-4ff6-bda6-19710347ae74","Type":"ContainerStarted","Data":"d7f7fa400a1668474fbd73076f130ec4565f629de21ac6af32e3172c07dda19f"} Oct 30 23:35:02.040305 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:02.037315 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-mbbk5" podStartSLOduration=441.037299628 podStartE2EDuration="7m21.037299628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:27:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:02.03334644 +0000 UTC m=+32.756066890" watchObservedRunningTime="2026-10-30 23:35:02.037299628 +0000 UTC m=+32.760020049" Oct 30 23:35:02.070965 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:02.070059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:02.070965 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:02.070142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:02.070965 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:02.070186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-7mrn6\" (UID: \"1302dd34-a67e-4861-96d8-1b98c2d2e314\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:02.070965 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:02.070216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:02.070965 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:02.070258 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:02.070965 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:02.070556 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 23:35:02.070965 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:02.070577 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:02.070965 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:02.070591 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865f789994-pzwps: secret "image-registry-tls" not found Oct 30 23:35:02.070965 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:02.070616 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert podName:1302dd34-a67e-4861-96d8-1b98c2d2e314 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:04.070598703 +0000 UTC m=+34.793319119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-7mrn6" (UID: "1302dd34-a67e-4861-96d8-1b98c2d2e314") : secret "networking-console-plugin-cert" not found Oct 30 23:35:02.070965 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:02.070634 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls podName:05a8da7c-7313-471b-8437-fff42cdbda65 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:04.070624645 +0000 UTC m=+34.793345042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls") pod "image-registry-865f789994-pzwps" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65") : secret "image-registry-tls" not found Oct 30 23:35:02.070965 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:02.070670 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 23:35:02.070965 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:02.070681 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 23:35:02.070965 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:02.070701 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls podName:a89e6ed3-bb09-4d7f-85cb-092cd129b7bb nodeName:}" failed. No retries permitted until 2026-10-30 23:35:04.070690671 +0000 UTC m=+34.793411083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-87pc8" (UID: "a89e6ed3-bb09-4d7f-85cb-092cd129b7bb") : secret "samples-operator-tls" not found Oct 30 23:35:02.070965 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:02.070716 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs podName:f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:04.070708192 +0000 UTC m=+34.793428599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs") pod "router-default-5b5577b589-v98nd" (UID: "f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4") : secret "router-metrics-certs-default" not found Oct 30 23:35:02.070965 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:02.070774 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle podName:f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:04.070764482 +0000 UTC m=+34.793484893 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle") pod "router-default-5b5577b589-v98nd" (UID: "f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4") : configmap references non-existent config key: service-ca.crt Oct 30 23:35:02.073902 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:02.072813 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-m926q" podStartSLOduration=441.072799702 podStartE2EDuration="7m21.072799702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:27:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:02.07246854 +0000 UTC m=+32.795188960" watchObservedRunningTime="2026-10-30 23:35:02.072799702 +0000 UTC m=+32.795520124" Oct 30 23:35:02.118740 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:02.117300 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-7z66c" podStartSLOduration=441.117284689 podStartE2EDuration="7m21.117284689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:27:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:02.116956322 +0000 UTC m=+32.839676744" watchObservedRunningTime="2026-10-30 23:35:02.117284689 +0000 UTC m=+32.840005089" Oct 30 23:35:02.272674 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:02.272637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:02.272857 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:02.272724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:02.273375 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:02.272955 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 23:35:02.273375 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:02.273026 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls podName:b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d nodeName:}" failed. No retries permitted until 2026-10-30 23:35:04.273008552 +0000 UTC m=+34.995728949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls") pod "dns-default-qpgjl" (UID: "b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d") : secret "dns-default-metrics-tls" not found Oct 30 23:35:02.273375 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:02.273061 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:02.273375 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:02.273084 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6749d98767-f4mjs: secret "image-registry-tls" not found Oct 30 23:35:02.273375 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:02.273139 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls podName:2f5051b3-19d4-422e-a8d1-47129e287d57 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:04.273120613 +0000 UTC m=+34.995841010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls") pod "image-registry-6749d98767-f4mjs" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57") : secret "image-registry-tls" not found Oct 30 23:35:03.485502 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:03.485081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:35:03.507838 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:03.507773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:35:03.586690 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:03.586656 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb9b4\" (UniqueName: \"kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4\") pod \"network-check-target-2rjct\" (UID: \"3e87ca45-ff16-44e3-a360-5252e624f610\") " pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:35:03.586823 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:03.586710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:35:03.586908 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:03.586891 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 23:35:03.586973 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:03.586961 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs podName:969fd947-a81d-4e6a-b369-550efce8f665 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:35.58694279 +0000 UTC m=+66.309663189 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs") pod "network-metrics-daemon-cf6r4" (UID: "969fd947-a81d-4e6a-b369-550efce8f665") : secret "metrics-daemon-secret" not found Oct 30 23:35:03.589933 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:03.589905 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb9b4\" (UniqueName: \"kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4\") pod \"network-check-target-2rjct\" (UID: \"3e87ca45-ff16-44e3-a360-5252e624f610\") " pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:35:03.753588 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:03.753555 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:35:03.764027 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:03.763967 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:35:03.991378 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:03.990671 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:03.991378 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:03.990941 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 23:35:03.991378 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:03.991005 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls podName:938e07e9-87b4-4618-87c0-b59bd13e7282 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:07.990987031 +0000 UTC m=+38.713707446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-sc2z6" (UID: "938e07e9-87b4-4618-87c0-b59bd13e7282") : secret "cluster-monitoring-operator-tls" not found Oct 30 23:35:04.027704 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:04.026908 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cht6c" event={"ID":"f2ba63b6-5f40-4d47-9b46-ec9f8888edce","Type":"ContainerStarted","Data":"910deffe67b9ce513ad973de8bfa6d0ab08420a89e43e76af03caef43cec6fa3"} Oct 30 23:35:04.065998 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:04.065952 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cht6c" podStartSLOduration=411.912857782 podStartE2EDuration="6m54.065938383s" totalImagesPullingTime="2.153080601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:04.064856744 +0000 UTC m=+34.787577164" watchObservedRunningTime="2026-10-30 23:35:04.065938383 +0000 UTC m=+34.788658802" Oct 30 23:35:04.091395 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:04.091364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:04.091554 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:04.091418 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-7mrn6\" (UID: \"1302dd34-a67e-4861-96d8-1b98c2d2e314\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:04.091554 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:04.091450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:04.091554 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:04.091497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:04.091741 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:04.091570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:04.091741 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:04.091666 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:04.091741 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:04.091678 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865f789994-pzwps: secret "image-registry-tls" not found Oct 30 23:35:04.091741 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:04.091732 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls podName:05a8da7c-7313-471b-8437-fff42cdbda65 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:08.091704286 +0000 UTC m=+38.814424683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls") pod "image-registry-865f789994-pzwps" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65") : secret "image-registry-tls" not found Oct 30 23:35:04.092034 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:04.092014 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 23:35:04.092135 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:04.092123 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs podName:f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:08.092107316 +0000 UTC m=+38.814827715 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs") pod "router-default-5b5577b589-v98nd" (UID: "f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4") : secret "router-metrics-certs-default" not found Oct 30 23:35:04.092186 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:04.092154 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle podName:f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:08.09214325 +0000 UTC m=+38.814863662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle") pod "router-default-5b5577b589-v98nd" (UID: "f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4") : configmap references non-existent config key: service-ca.crt Oct 30 23:35:04.092186 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:04.092175 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 23:35:04.092243 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:04.092208 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 23:35:04.092243 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:04.092226 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert podName:1302dd34-a67e-4861-96d8-1b98c2d2e314 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:08.092212968 +0000 UTC m=+38.814933366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-7mrn6" (UID: "1302dd34-a67e-4861-96d8-1b98c2d2e314") : secret "networking-console-plugin-cert" not found Oct 30 23:35:04.092333 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:04.092243 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls podName:a89e6ed3-bb09-4d7f-85cb-092cd129b7bb nodeName:}" failed. No retries permitted until 2026-10-30 23:35:08.092232321 +0000 UTC m=+38.814952719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-87pc8" (UID: "a89e6ed3-bb09-4d7f-85cb-092cd129b7bb") : secret "samples-operator-tls" not found Oct 30 23:35:04.102725 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:04.102701 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2rjct"] Oct 30 23:35:04.112223 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:35:04.112194 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e87ca45_ff16_44e3_a360_5252e624f610.slice/crio-0a5671d5f669eac810a29bc6bfffa9de3f39d71b38dac381eb3000b977e02357 WatchSource:0}: Error finding container 0a5671d5f669eac810a29bc6bfffa9de3f39d71b38dac381eb3000b977e02357: Status 404 returned error can't find the container with id 0a5671d5f669eac810a29bc6bfffa9de3f39d71b38dac381eb3000b977e02357 Oct 30 23:35:04.124146 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:04.124124 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bqgch"] Oct 30 23:35:04.127843 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:35:04.127814 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6ef5c6_97aa_41b8_94bd_c1fe2f940f91.slice/crio-463522e03d08c17f36e838292c962e12315b942c7ac4f348f625ddf49ef0b608 WatchSource:0}: Error finding container 463522e03d08c17f36e838292c962e12315b942c7ac4f348f625ddf49ef0b608: Status 404 returned error can't find the container with id 463522e03d08c17f36e838292c962e12315b942c7ac4f348f625ddf49ef0b608 Oct 30 23:35:04.294456 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:04.294384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:04.294596 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:04.294456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:04.294664 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:04.294597 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 23:35:04.294664 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:04.294653 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls podName:b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d nodeName:}" failed. No retries permitted until 2026-10-30 23:35:08.29463544 +0000 UTC m=+39.017355857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls") pod "dns-default-qpgjl" (UID: "b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d") : secret "dns-default-metrics-tls" not found Oct 30 23:35:04.295032 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:04.295013 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:04.295032 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:04.295033 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6749d98767-f4mjs: secret "image-registry-tls" not found Oct 30 23:35:04.295223 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:04.295183 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls podName:2f5051b3-19d4-422e-a8d1-47129e287d57 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:08.2951658 +0000 UTC m=+39.017886211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls") pod "image-registry-6749d98767-f4mjs" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57") : secret "image-registry-tls" not found Oct 30 23:35:05.032266 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:05.032186 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2rjct" event={"ID":"3e87ca45-ff16-44e3-a360-5252e624f610","Type":"ContainerStarted","Data":"0a5671d5f669eac810a29bc6bfffa9de3f39d71b38dac381eb3000b977e02357"} Oct 30 23:35:05.034543 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:05.034470 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bqgch" event={"ID":"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91","Type":"ContainerStarted","Data":"463522e03d08c17f36e838292c962e12315b942c7ac4f348f625ddf49ef0b608"} Oct 30 23:35:06.049410 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.047355 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" event={"ID":"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6","Type":"ContainerStarted","Data":"51ca39f33e4168b4230fcc85d36acf8a20666014e6729cec88fad96bf9e070b9"} Oct 30 23:35:06.050291 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.050255 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/0.log" Oct 30 23:35:06.050407 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.050297 2576 generic.go:356] "Generic (PLEG): container finished" podID="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" containerID="7982333e288051ded14ff28b8f692903e67a62643865fb7bb0e2fe8b41ace5c6" exitCode=255 Oct 30 23:35:06.050407 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.050383 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" event={"ID":"707fcc17-c66a-458e-bcb5-8b3558dbe8c4","Type":"ContainerDied","Data":"7982333e288051ded14ff28b8f692903e67a62643865fb7bb0e2fe8b41ace5c6"} Oct 30 23:35:06.050710 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.050693 2576 scope.go:122] "RemoveContainer" containerID="7982333e288051ded14ff28b8f692903e67a62643865fb7bb0e2fe8b41ace5c6" Oct 30 23:35:06.053190 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.053127 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" event={"ID":"85f5885d-de4d-472f-aa8e-036454ea9a4d","Type":"ContainerStarted","Data":"c57b4e9b958bed8a58c50f99a711303964abb4914e05741bf20640eec879b3d6"} Oct 30 23:35:06.055647 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.055239 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-dwmwv" event={"ID":"9cb59a65-5d33-4842-abe0-582372433b12","Type":"ContainerStarted","Data":"7474a42d2f1e0565ef843f9465a74f4881106fa1216f64157b897f089966c3cf"} Oct 30 23:35:06.089230 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.089183 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" podStartSLOduration=411.247236279 podStartE2EDuration="6m56.089167937s" totalImagesPullingTime="4.841931658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:06.087806446 +0000 UTC m=+36.810526866" watchObservedRunningTime="2026-10-30 23:35:06.089167937 +0000 UTC m=+36.811888359" Oct 30 23:35:06.170736 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.169930 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-dwmwv" podStartSLOduration=412.075737328 podStartE2EDuration="6m56.16991711s" totalImagesPullingTime="4.094179782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:06.168991039 +0000 UTC m=+36.891711460" watchObservedRunningTime="2026-10-30 23:35:06.16991711 +0000 UTC m=+36.892637526" Oct 30 23:35:06.170736 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.170452 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" podStartSLOduration=411.540716302 podStartE2EDuration="6m56.170443383s" totalImagesPullingTime="4.629727081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:06.128074148 +0000 UTC m=+36.850794567" watchObservedRunningTime="2026-10-30 23:35:06.170443383 +0000 UTC m=+36.893163846" Oct 30 23:35:06.876981 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.876907 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-6stc8"] Oct 30 23:35:06.898838 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.898647 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-wtjbd"] Oct 30 23:35:06.900161 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.899337 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6stc8" Oct 30 23:35:06.915876 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.915852 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:06.917423 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.917372 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bj9t9\"" Oct 30 23:35:06.917541 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.917450 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 23:35:06.922714 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.922693 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-6stc8"] Oct 30 23:35:06.922850 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.922733 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-wtjbd"] Oct 30 23:35:06.922850 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.922835 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-wtjbd" Oct 30 23:35:06.988594 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:06.988567 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-hzzjp"] Oct 30 23:35:07.014237 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.014204 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-hzzjp"] Oct 30 23:35:07.014361 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.014323 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:07.031962 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.031936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts5mb\" (UniqueName: \"kubernetes.io/projected/c5c08ca6-298f-4819-a28e-d4699cad5741-kube-api-access-ts5mb\") pod \"migrator-66df5d496b-6stc8\" (UID: \"c5c08ca6-298f-4819-a28e-d4699cad5741\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6stc8" Oct 30 23:35:07.032198 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.032170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbqzq\" (UniqueName: \"kubernetes.io/projected/ff7c1c2f-66d7-412e-b86c-a8502e575609-kube-api-access-tbqzq\") pod \"migrator-66df5d496b-wtjbd\" (UID: \"ff7c1c2f-66d7-412e-b86c-a8502e575609\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-wtjbd" Oct 30 23:35:07.033687 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.033626 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 30 23:35:07.033687 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.033641 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 30 23:35:07.033687 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.033641 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 30 23:35:07.033687 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.033681 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 30 23:35:07.033894 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.033719 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-t8pc7\"" Oct 30 23:35:07.062177 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.062146 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m5ssb" event={"ID":"55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5","Type":"ContainerStarted","Data":"4a8abf15e8c2ce95f48bc82a644a3b28ffa30fcd65b4bcd30d5ad054839bddcb"} Oct 30 23:35:07.066022 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.065971 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/1.log" Oct 30 23:35:07.066752 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.066478 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/0.log" Oct 30 23:35:07.066752 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.066514 2576 generic.go:356] "Generic (PLEG): container finished" podID="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" containerID="3ea4b50601647a9ba5327b72953a23ad0585b88fc5790b48a10ea397a9a5779a" exitCode=255 Oct 30 23:35:07.066752 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.066601 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" event={"ID":"707fcc17-c66a-458e-bcb5-8b3558dbe8c4","Type":"ContainerDied","Data":"3ea4b50601647a9ba5327b72953a23ad0585b88fc5790b48a10ea397a9a5779a"} Oct 30 23:35:07.066752 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.066646 2576 scope.go:122] "RemoveContainer" containerID="7982333e288051ded14ff28b8f692903e67a62643865fb7bb0e2fe8b41ace5c6" Oct 30 23:35:07.066949 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.066788 2576 scope.go:122] "RemoveContainer" containerID="3ea4b50601647a9ba5327b72953a23ad0585b88fc5790b48a10ea397a9a5779a" Oct 30 23:35:07.066998 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:07.066967 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-958pp_openshift-console-operator(707fcc17-c66a-458e-bcb5-8b3558dbe8c4)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" podUID="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" Oct 30 23:35:07.085352 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.085314 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gkvsl"] Oct 30 23:35:07.100088 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.100031 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-tb5lv-n7p5n"] Oct 30 23:35:07.100179 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.100153 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.109428 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.109385 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m5ssb" podStartSLOduration=1.836942579 podStartE2EDuration="7.109369065s" totalImagesPullingTime="5.272426486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:07.109031349 +0000 UTC m=+37.831751769" watchObservedRunningTime="2026-10-30 23:35:07.109369065 +0000 UTC m=+37.832089484" Oct 30 23:35:07.130139 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.128526 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gkvsl"] Oct 30 23:35:07.130139 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.128600 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-tb5lv-n7p5n"] Oct 30 23:35:07.130139 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.128697 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:07.133181 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.133153 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zdn2\" (UniqueName: \"kubernetes.io/projected/5d5343c7-fe93-4ee6-a987-d478c7801430-kube-api-access-8zdn2\") pod \"service-ca-5fffc97bdf-hzzjp\" (UID: \"5d5343c7-fe93-4ee6-a987-d478c7801430\") " pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:07.133313 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.133297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5d5343c7-fe93-4ee6-a987-d478c7801430-signing-key\") pod \"service-ca-5fffc97bdf-hzzjp\" (UID: \"5d5343c7-fe93-4ee6-a987-d478c7801430\") " pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:07.133366 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.133352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts5mb\" (UniqueName: \"kubernetes.io/projected/c5c08ca6-298f-4819-a28e-d4699cad5741-kube-api-access-ts5mb\") pod \"migrator-66df5d496b-6stc8\" (UID: \"c5c08ca6-298f-4819-a28e-d4699cad5741\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6stc8" Oct 30 23:35:07.133411 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.133398 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5d5343c7-fe93-4ee6-a987-d478c7801430-signing-cabundle\") pod \"service-ca-5fffc97bdf-hzzjp\" (UID: \"5d5343c7-fe93-4ee6-a987-d478c7801430\") " pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:07.133534 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.133520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbqzq\" (UniqueName: \"kubernetes.io/projected/ff7c1c2f-66d7-412e-b86c-a8502e575609-kube-api-access-tbqzq\") pod \"migrator-66df5d496b-wtjbd\" (UID: \"ff7c1c2f-66d7-412e-b86c-a8502e575609\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-wtjbd" Oct 30 23:35:07.134335 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.134309 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 23:35:07.134423 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.134407 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 23:35:07.134468 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.134428 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vskkf\"" Oct 30 23:35:07.153805 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.153779 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbqzq\" (UniqueName: \"kubernetes.io/projected/ff7c1c2f-66d7-412e-b86c-a8502e575609-kube-api-access-tbqzq\") pod \"migrator-66df5d496b-wtjbd\" (UID: \"ff7c1c2f-66d7-412e-b86c-a8502e575609\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-wtjbd" Oct 30 23:35:07.156669 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.156644 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts5mb\" (UniqueName: \"kubernetes.io/projected/c5c08ca6-298f-4819-a28e-d4699cad5741-kube-api-access-ts5mb\") pod \"migrator-66df5d496b-6stc8\" (UID: \"c5c08ca6-298f-4819-a28e-d4699cad5741\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6stc8" Oct 30 23:35:07.230518 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.230457 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6stc8" Oct 30 23:35:07.234426 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.234400 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3549b0b4-488b-4819-b37a-8a566c3d5514-archives-path\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:07.234663 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.234634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krsnz\" (UniqueName: \"kubernetes.io/projected/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-api-access-krsnz\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.234762 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.234719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5d5343c7-fe93-4ee6-a987-d478c7801430-signing-key\") pod \"service-ca-5fffc97bdf-hzzjp\" (UID: \"5d5343c7-fe93-4ee6-a987-d478c7801430\") " pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:07.234762 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.234753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-trusted-ca-bundle\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:07.234881 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.234783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-service-ca-bundle\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:07.235257 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.235233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.235332 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.235316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5d5343c7-fe93-4ee6-a987-d478c7801430-signing-cabundle\") pod \"service-ca-5fffc97bdf-hzzjp\" (UID: \"5d5343c7-fe93-4ee6-a987-d478c7801430\") " pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:07.235561 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.235528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtchh\" (UniqueName: \"kubernetes.io/projected/3549b0b4-488b-4819-b37a-8a566c3d5514-kube-api-access-vtchh\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:07.235696 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.235678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.235756 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.235712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb41b0b9-c085-4343-be37-07f224fc4f8e-data-volume\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.235756 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.235742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb41b0b9-c085-4343-be37-07f224fc4f8e-crio-socket\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.236094 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.236069 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5d5343c7-fe93-4ee6-a987-d478c7801430-signing-cabundle\") pod \"service-ca-5fffc97bdf-hzzjp\" (UID: \"5d5343c7-fe93-4ee6-a987-d478c7801430\") " pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:07.236160 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.236091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zdn2\" (UniqueName: \"kubernetes.io/projected/5d5343c7-fe93-4ee6-a987-d478c7801430-kube-api-access-8zdn2\") pod \"service-ca-5fffc97bdf-hzzjp\" (UID: \"5d5343c7-fe93-4ee6-a987-d478c7801430\") " pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:07.238731 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.238713 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5d5343c7-fe93-4ee6-a987-d478c7801430-signing-key\") pod \"service-ca-5fffc97bdf-hzzjp\" (UID: \"5d5343c7-fe93-4ee6-a987-d478c7801430\") " pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:07.259495 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.259473 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-wtjbd" Oct 30 23:35:07.263514 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.263492 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zdn2\" (UniqueName: \"kubernetes.io/projected/5d5343c7-fe93-4ee6-a987-d478c7801430-kube-api-access-8zdn2\") pod \"service-ca-5fffc97bdf-hzzjp\" (UID: \"5d5343c7-fe93-4ee6-a987-d478c7801430\") " pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.336614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.336671 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb41b0b9-c085-4343-be37-07f224fc4f8e-data-volume\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.336705 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb41b0b9-c085-4343-be37-07f224fc4f8e-crio-socket\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.336760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3549b0b4-488b-4819-b37a-8a566c3d5514-archives-path\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.336829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krsnz\" (UniqueName: \"kubernetes.io/projected/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-api-access-krsnz\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.336868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-trusted-ca-bundle\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.336896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-service-ca-bundle\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.336928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.337019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtchh\" (UniqueName: \"kubernetes.io/projected/3549b0b4-488b-4819-b37a-8a566c3d5514-kube-api-access-vtchh\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:07.337499 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:07.337570 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-rbac-proxy-cm podName:fb41b0b9-c085-4343-be37-07f224fc4f8e nodeName:}" failed. No retries permitted until 2026-10-30 23:35:07.837549997 +0000 UTC m=+38.560270409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gkvsl" (UID: "fb41b0b9-c085-4343-be37-07f224fc4f8e") : configmap "kube-rbac-proxy" not found Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.338113 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb41b0b9-c085-4343-be37-07f224fc4f8e-data-volume\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.338309 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb41b0b9-c085-4343-be37-07f224fc4f8e-crio-socket\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.338395 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.339393 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-trusted-ca-bundle\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.339694 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3549b0b4-488b-4819-b37a-8a566c3d5514-archives-path\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:07.340626 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:07.340034 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 23:35:07.341527 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:07.340098 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls podName:fb41b0b9-c085-4343-be37-07f224fc4f8e nodeName:}" failed. No retries permitted until 2026-10-30 23:35:07.840081424 +0000 UTC m=+38.562801840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkvsl" (UID: "fb41b0b9-c085-4343-be37-07f224fc4f8e") : secret "insights-runtime-extractor-tls" not found Oct 30 23:35:07.341527 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.340574 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-service-ca-bundle\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:07.361230 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.360663 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtchh\" (UniqueName: \"kubernetes.io/projected/3549b0b4-488b-4819-b37a-8a566c3d5514-kube-api-access-vtchh\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:07.362084 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.362027 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krsnz\" (UniqueName: \"kubernetes.io/projected/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-api-access-krsnz\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.496193 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.496156 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:07.554647 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.554621 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-6stc8"] Oct 30 23:35:07.595864 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.595449 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-wtjbd"] Oct 30 23:35:07.668737 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.668671 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-hzzjp"] Oct 30 23:35:07.673394 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:35:07.673369 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d5343c7_fe93_4ee6_a987_d478c7801430.slice/crio-427cdfa6f091964001512d0663a6c20f29afced2a3d068c041f2d3602fbcb191 WatchSource:0}: Error finding container 427cdfa6f091964001512d0663a6c20f29afced2a3d068c041f2d3602fbcb191: Status 404 returned error can't find the container with id 427cdfa6f091964001512d0663a6c20f29afced2a3d068c041f2d3602fbcb191 Oct 30 23:35:07.842939 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.842255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.842939 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.842398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:07.842939 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:07.842566 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 23:35:07.842939 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:07.842624 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls podName:fb41b0b9-c085-4343-be37-07f224fc4f8e nodeName:}" failed. No retries permitted until 2026-10-30 23:35:08.842605667 +0000 UTC m=+39.565326066 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkvsl" (UID: "fb41b0b9-c085-4343-be37-07f224fc4f8e") : secret "insights-runtime-extractor-tls" not found Oct 30 23:35:07.842939 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:07.842688 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-tb5lv-n7p5n"] Oct 30 23:35:07.842939 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:07.842777 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 23:35:07.842939 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:07.842818 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-rbac-proxy-cm podName:fb41b0b9-c085-4343-be37-07f224fc4f8e nodeName:}" failed. No retries permitted until 2026-10-30 23:35:08.84280599 +0000 UTC m=+39.565526388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gkvsl" (UID: "fb41b0b9-c085-4343-be37-07f224fc4f8e") : configmap "kube-rbac-proxy" not found Oct 30 23:35:07.848950 ip-10-0-138-142 kubenswrapper[2576]: W1030 23:35:07.848922 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3549b0b4_488b_4819_b37a_8a566c3d5514.slice/crio-19e49b903e4ec8feb935e7992b2694f45944d5bc91916ad12270fd5ae3205eac WatchSource:0}: Error finding container 19e49b903e4ec8feb935e7992b2694f45944d5bc91916ad12270fd5ae3205eac: Status 404 returned error can't find the container with id 19e49b903e4ec8feb935e7992b2694f45944d5bc91916ad12270fd5ae3205eac Oct 30 23:35:08.044662 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.044563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:08.044814 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.044746 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 23:35:08.044814 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.044811 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls podName:938e07e9-87b4-4618-87c0-b59bd13e7282 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:16.044796093 +0000 UTC m=+46.767516494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-sc2z6" (UID: "938e07e9-87b4-4618-87c0-b59bd13e7282") : secret "cluster-monitoring-operator-tls" not found Oct 30 23:35:08.071744 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.071708 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-wtjbd" event={"ID":"ff7c1c2f-66d7-412e-b86c-a8502e575609","Type":"ContainerStarted","Data":"8f50233a1793e5e33f6d9866170fafca59e1a6926c3d766eebb49a01835d7a6f"} Oct 30 23:35:08.073892 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.073791 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" event={"ID":"5d5343c7-fe93-4ee6-a987-d478c7801430","Type":"ContainerStarted","Data":"f50e660ebb7cbfe7860ce7feb70fef22ed03b8f2878328a65cada535f963506a"} Oct 30 23:35:08.073892 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.073852 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" event={"ID":"5d5343c7-fe93-4ee6-a987-d478c7801430","Type":"ContainerStarted","Data":"427cdfa6f091964001512d0663a6c20f29afced2a3d068c041f2d3602fbcb191"} Oct 30 23:35:08.075892 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.075875 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/1.log" Oct 30 23:35:08.076236 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.076216 2576 scope.go:122] "RemoveContainer" containerID="3ea4b50601647a9ba5327b72953a23ad0585b88fc5790b48a10ea397a9a5779a" Oct 30 23:35:08.076422 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.076401 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-958pp_openshift-console-operator(707fcc17-c66a-458e-bcb5-8b3558dbe8c4)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" podUID="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" Oct 30 23:35:08.077592 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.077568 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6stc8" event={"ID":"c5c08ca6-298f-4819-a28e-d4699cad5741","Type":"ContainerStarted","Data":"993443a77d7d4821c6891068d3ccfad34f1aeb035db06115b7a4be54d074e2e1"} Oct 30 23:35:08.079786 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.079722 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" event={"ID":"3549b0b4-488b-4819-b37a-8a566c3d5514","Type":"ContainerStarted","Data":"f60ba745edbb8a33ac60f67e681bd61c037561fc3ee45886786b63d8dea62624"} Oct 30 23:35:08.079786 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.079758 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" event={"ID":"3549b0b4-488b-4819-b37a-8a566c3d5514","Type":"ContainerStarted","Data":"19e49b903e4ec8feb935e7992b2694f45944d5bc91916ad12270fd5ae3205eac"} Oct 30 23:35:08.114102 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.114055 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" podStartSLOduration=2.114028663 podStartE2EDuration="2.114028663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:08.113198278 +0000 UTC m=+38.835918697" watchObservedRunningTime="2026-10-30 23:35:08.114028663 +0000 UTC m=+38.836749083" Oct 30 23:35:08.146262 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.146236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:08.146355 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.146328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:08.146421 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.146373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-7mrn6\" (UID: \"1302dd34-a67e-4861-96d8-1b98c2d2e314\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:08.146421 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.146380 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:08.146421 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.146401 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865f789994-pzwps: secret "image-registry-tls" not found Oct 30 23:35:08.146421 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.146403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:08.146597 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.146450 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls podName:05a8da7c-7313-471b-8437-fff42cdbda65 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:16.146435641 +0000 UTC m=+46.869156071 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls") pod "image-registry-865f789994-pzwps" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65") : secret "image-registry-tls" not found Oct 30 23:35:08.146597 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.146470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:08.146597 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.146509 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle podName:f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:16.146498867 +0000 UTC m=+46.869219263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle") pod "router-default-5b5577b589-v98nd" (UID: "f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4") : configmap references non-existent config key: service-ca.crt Oct 30 23:35:08.146597 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.146540 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 23:35:08.146597 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.146568 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls podName:a89e6ed3-bb09-4d7f-85cb-092cd129b7bb nodeName:}" failed. No retries permitted until 2026-10-30 23:35:16.146560796 +0000 UTC m=+46.869281217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-87pc8" (UID: "a89e6ed3-bb09-4d7f-85cb-092cd129b7bb") : secret "samples-operator-tls" not found Oct 30 23:35:08.146597 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.146588 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 23:35:08.146877 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.146615 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs podName:f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:16.146606213 +0000 UTC m=+46.869326610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs") pod "router-default-5b5577b589-v98nd" (UID: "f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4") : secret "router-metrics-certs-default" not found Oct 30 23:35:08.146877 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.146660 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 23:35:08.146877 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.146680 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert podName:1302dd34-a67e-4861-96d8-1b98c2d2e314 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:16.146673964 +0000 UTC m=+46.869394361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-7mrn6" (UID: "1302dd34-a67e-4861-96d8-1b98c2d2e314") : secret "networking-console-plugin-cert" not found Oct 30 23:35:08.196568 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.196488 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" podStartSLOduration=1.196472374 podStartE2EDuration="1.196472374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:08.194816573 +0000 UTC m=+38.917536992" watchObservedRunningTime="2026-10-30 23:35:08.196472374 +0000 UTC m=+38.919192794" Oct 30 23:35:08.350324 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.349677 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:08.350324 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.349756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:08.350324 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.349871 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 23:35:08.350324 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.349915 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls podName:b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d nodeName:}" failed. No retries permitted until 2026-10-30 23:35:16.349899857 +0000 UTC m=+47.072620260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls") pod "dns-default-qpgjl" (UID: "b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d") : secret "dns-default-metrics-tls" not found Oct 30 23:35:08.350324 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.349979 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:08.350324 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.349991 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6749d98767-f4mjs: secret "image-registry-tls" not found Oct 30 23:35:08.350324 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.350024 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls podName:2f5051b3-19d4-422e-a8d1-47129e287d57 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:16.350013434 +0000 UTC m=+47.072733831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls") pod "image-registry-6749d98767-f4mjs" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57") : secret "image-registry-tls" not found Oct 30 23:35:08.856070 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.855275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:08.856070 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:08.855425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:08.856070 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.855585 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 23:35:08.856070 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.855636 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-rbac-proxy-cm podName:fb41b0b9-c085-4343-be37-07f224fc4f8e nodeName:}" failed. No retries permitted until 2026-10-30 23:35:10.855623705 +0000 UTC m=+41.578344115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gkvsl" (UID: "fb41b0b9-c085-4343-be37-07f224fc4f8e") : configmap "kube-rbac-proxy" not found Oct 30 23:35:08.856070 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.855991 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 23:35:08.856070 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:08.856032 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls podName:fb41b0b9-c085-4343-be37-07f224fc4f8e nodeName:}" failed. No retries permitted until 2026-10-30 23:35:10.856021123 +0000 UTC m=+41.578741533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkvsl" (UID: "fb41b0b9-c085-4343-be37-07f224fc4f8e") : secret "insights-runtime-extractor-tls" not found Oct 30 23:35:09.091252 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:09.091222 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-cgrj8" event={"ID":"fcf08154-6f21-453e-9028-7377db286d04","Type":"ContainerStarted","Data":"7d44e66dd6c7d0f3db504777b0b468ddc1a997dbd74b931d28fd067c68e0a5e9"} Oct 30 23:35:09.135100 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:09.133526 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-cgrj8" podStartSLOduration=411.080498953 podStartE2EDuration="6m58.133506218s" totalImagesPullingTime="7.053007265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:09.133183996 +0000 UTC m=+39.855904415" watchObservedRunningTime="2026-10-30 23:35:09.133506218 +0000 UTC m=+39.856226641" Oct 30 23:35:10.095645 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:10.095567 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2rjct" event={"ID":"3e87ca45-ff16-44e3-a360-5252e624f610","Type":"ContainerStarted","Data":"7b9b1963d28a898a81bddaa1ed855322bc5fba623278bd3c295b582ba1104f86"} Oct 30 23:35:10.096111 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:10.095952 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:35:10.137979 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:10.137931 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2rjct" podStartSLOduration=34.458395716 podStartE2EDuration="40.137918221s" totalImagesPullingTime="5.679522505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:10.136750606 +0000 UTC m=+40.859471026" watchObservedRunningTime="2026-10-30 23:35:10.137918221 +0000 UTC m=+40.860638640" Oct 30 23:35:10.497391 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:10.497326 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kh84m_fc6ae729-bb57-4d5f-9112-69dc5d0abee9/dns-node-resolver/0.log" Oct 30 23:35:10.610848 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:10.610813 2576 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:10.611219 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:10.611204 2576 scope.go:122] "RemoveContainer" containerID="3ea4b50601647a9ba5327b72953a23ad0585b88fc5790b48a10ea397a9a5779a" Oct 30 23:35:10.611410 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:10.611390 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-958pp_openshift-console-operator(707fcc17-c66a-458e-bcb5-8b3558dbe8c4)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" podUID="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" Oct 30 23:35:10.611519 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:10.611498 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:10.891790 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:10.891019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:10.891790 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:10.891166 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 23:35:10.891790 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:10.891215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:10.891790 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:10.891241 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls podName:fb41b0b9-c085-4343-be37-07f224fc4f8e nodeName:}" failed. No retries permitted until 2026-10-30 23:35:14.891218922 +0000 UTC m=+45.613939336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkvsl" (UID: "fb41b0b9-c085-4343-be37-07f224fc4f8e") : secret "insights-runtime-extractor-tls" not found Oct 30 23:35:10.891790 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:10.891747 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:11.100033 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:11.099993 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6stc8" event={"ID":"c5c08ca6-298f-4819-a28e-d4699cad5741","Type":"ContainerStarted","Data":"8c0dd8b4d6f0cb943ded7341799553338eb6978947cf34265bb03c01f44cc441"} Oct 30 23:35:11.101347 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:11.101313 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-wtjbd" event={"ID":"ff7c1c2f-66d7-412e-b86c-a8502e575609","Type":"ContainerStarted","Data":"bae18ef1f287aa8cfdef1ade5369bcf8d685ff1cdc25a02d23e8592cbdcd84bb"} Oct 30 23:35:11.101501 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:11.101485 2576 scope.go:122] "RemoveContainer" containerID="3ea4b50601647a9ba5327b72953a23ad0585b88fc5790b48a10ea397a9a5779a" Oct 30 23:35:11.101647 ip-10-0-138-142 kubenswrapper[2576]: E1030 23:35:11.101632 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-958pp_openshift-console-operator(707fcc17-c66a-458e-bcb5-8b3558dbe8c4)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" podUID="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" Oct 30 23:35:11.138493 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:11.138453 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6stc8" podStartSLOduration=2.526140386 podStartE2EDuration="5.138441612s" totalImagesPullingTime="2.612301226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:11.138240814 +0000 UTC m=+41.860961233" watchObservedRunningTime="2026-10-30 23:35:11.138441612 +0000 UTC m=+41.861162032" Oct 30 23:35:11.178475 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:11.178411 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-wtjbd" podStartSLOduration=2.608639133 podStartE2EDuration="5.178399818s" totalImagesPullingTime="2.569760685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:11.177668551 +0000 UTC m=+41.900388971" watchObservedRunningTime="2026-10-30 23:35:11.178399818 +0000 UTC m=+41.901120237" Oct 30 23:35:11.497020 ip-10-0-138-142 kubenswrapper[2576]: I1030 23:35:11.497001 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xcbst_c9448c7a-5b0e-4ff7-808b-889a0d8b022f/node-ca/0.log" Oct 30 23:35:11.685027 ip-10-0-138-142 systemd[1]: Stopping Kubernetes Kubelet... Oct 30 23:35:11.697557 ip-10-0-138-142 systemd[1]: kubelet.service: Deactivated successfully. Oct 30 23:35:11.697763 ip-10-0-138-142 systemd[1]: Stopped Kubernetes Kubelet. Oct 30 23:35:11.697820 ip-10-0-138-142 systemd[1]: kubelet.service: Consumed 3.053s CPU time. Oct 30 23:35:11.706652 ip-10-0-138-142 systemd[1]: Starting Kubernetes Kubelet... Oct 30 23:35:11.784197 ip-10-0-138-142 kubenswrapper[5112]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 23:35:11.784197 ip-10-0-138-142 kubenswrapper[5112]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 23:35:11.784197 ip-10-0-138-142 kubenswrapper[5112]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 23:35:11.784197 ip-10-0-138-142 kubenswrapper[5112]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 23:35:11.786223 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786161 5112 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:11.786223 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786223 5112 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786227 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786232 5112 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786235 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786237 5112 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786240 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786243 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786246 5112 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786248 5112 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786251 5112 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786254 5112 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786256 5112 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786259 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786262 5112 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786264 5112 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786267 5112 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786269 5112 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786273 5112 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786275 5112 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786278 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:11.786297 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786281 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786284 5112 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786286 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786289 5112 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786291 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786301 5112 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786304 5112 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786307 5112 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786310 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786312 5112 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786315 5112 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786317 5112 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786320 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786322 5112 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786325 5112 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786329 5112 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786334 5112 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786337 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786340 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:11.786810 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786343 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786346 5112 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786349 5112 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786351 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786354 5112 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786356 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786359 5112 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786362 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786364 5112 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786367 5112 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786369 5112 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786371 5112 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786374 5112 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786377 5112 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786380 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786385 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786388 5112 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786391 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786393 5112 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786396 5112 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:11.787312 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786399 5112 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786401 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786404 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786407 5112 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786410 5112 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786412 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786415 5112 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786419 5112 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786423 5112 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786426 5112 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786429 5112 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786432 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786434 5112 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786437 5112 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786439 5112 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786442 5112 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786445 5112 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786447 5112 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786450 5112 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786452 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:11.787807 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786455 5112 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786457 5112 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786460 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786462 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786465 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786467 5112 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786470 5112 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786474 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786477 5112 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786479 5112 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786482 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786484 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786487 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786489 5112 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786492 5112 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786494 5112 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786497 5112 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786500 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786502 5112 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786505 5112 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:11.788323 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786507 5112 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786510 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786512 5112 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786515 5112 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786517 5112 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.786520 5112 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787329 5112 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787338 5112 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787341 5112 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787345 5112 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787348 5112 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787353 5112 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787356 5112 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787360 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787364 5112 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787367 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787370 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787372 5112 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787375 5112 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:11.788852 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787378 5112 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787381 5112 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787384 5112 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787388 5112 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787390 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787393 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787395 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787398 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787400 5112 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787403 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787405 5112 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787408 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787411 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787413 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787416 5112 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787418 5112 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787421 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787423 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787425 5112 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:11.789364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787428 5112 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787430 5112 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787433 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787436 5112 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787438 5112 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787441 5112 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787444 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787446 5112 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787449 5112 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787451 5112 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787454 5112 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787457 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787459 5112 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787462 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787465 5112 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787467 5112 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787470 5112 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787473 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787476 5112 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787479 5112 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:11.789833 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787481 5112 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787484 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787486 5112 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787488 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787491 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787493 5112 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787496 5112 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787498 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787501 5112 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787503 5112 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787506 5112 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787508 5112 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787511 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787514 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787516 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787519 5112 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787521 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787524 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787526 5112 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:11.790411 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787529 5112 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787531 5112 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787534 5112 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787536 5112 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787545 5112 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787548 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787551 5112 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787555 5112 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787559 5112 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787562 5112 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787569 5112 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787572 5112 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787575 5112 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787577 5112 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787580 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787583 5112 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787585 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787588 5112 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787590 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:11.790894 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787593 5112 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787595 5112 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787598 5112 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787601 5112 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787603 5112 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787607 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787610 5112 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787612 5112 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787615 5112 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787617 5112 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787620 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787623 5112 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787625 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787628 5112 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787630 5112 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.787633 5112 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788109 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788114 5112 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788117 5112 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788120 5112 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:11.791394 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788123 5112 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788125 5112 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788128 5112 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788131 5112 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788134 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788137 5112 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788142 5112 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788144 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788147 5112 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788149 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788155 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788157 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788160 5112 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788163 5112 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788166 5112 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788169 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788171 5112 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788174 5112 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788177 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:11.791953 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788179 5112 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788182 5112 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788185 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788187 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788190 5112 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788193 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788196 5112 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788200 5112 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788203 5112 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788207 5112 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788210 5112 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788212 5112 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788215 5112 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788217 5112 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788220 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788224 5112 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788228 5112 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788231 5112 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788234 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:11.792460 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788239 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788241 5112 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788244 5112 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788246 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788250 5112 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788252 5112 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788255 5112 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788258 5112 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788260 5112 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788263 5112 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788265 5112 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788268 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788271 5112 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788273 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788276 5112 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788279 5112 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788281 5112 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788284 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788286 5112 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788289 5112 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:11.792933 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788291 5112 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788294 5112 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788297 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788299 5112 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788302 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788304 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788307 5112 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788309 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788312 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788315 5112 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788317 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788320 5112 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788324 5112 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788327 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788330 5112 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788332 5112 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788336 5112 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788339 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788342 5112 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:11.793470 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788344 5112 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788347 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788349 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788352 5112 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788354 5112 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788357 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788359 5112 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788362 5112 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788365 5112 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788367 5112 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788370 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788373 5112 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788375 5112 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788378 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788381 5112 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788383 5112 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788386 5112 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788388 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788391 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788393 5112 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:11.793942 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788396 5112 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788399 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788401 5112 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788404 5112 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.788406 5112 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788494 5112 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788501 5112 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788507 5112 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788512 5112 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788518 5112 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788521 5112 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788525 5112 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788529 5112 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788532 5112 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788535 5112 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788539 5112 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788542 5112 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788545 5112 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788548 5112 flags.go:64] FLAG: --cgroup-root="" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788551 5112 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788554 5112 flags.go:64] FLAG: --client-ca-file="" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788557 5112 flags.go:64] FLAG: --cloud-provider="external" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788560 5112 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788563 5112 flags.go:64] FLAG: --cluster-domain="" Oct 30 23:35:11.794468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788566 5112 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788569 5112 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788573 5112 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788576 5112 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788580 5112 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788583 5112 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788586 5112 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788589 5112 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788592 5112 flags.go:64] FLAG: --contention-profiling="false" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788596 5112 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788599 5112 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788602 5112 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788605 5112 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788610 5112 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788614 5112 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788617 5112 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788620 5112 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788624 5112 flags.go:64] FLAG: --enable-server="true" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788627 5112 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788631 5112 flags.go:64] FLAG: --event-burst="100" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788635 5112 flags.go:64] FLAG: --event-qps="50" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788638 5112 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788641 5112 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788644 5112 flags.go:64] FLAG: --eviction-hard="" Oct 30 23:35:11.795075 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788647 5112 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788650 5112 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788653 5112 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788656 5112 flags.go:64] FLAG: --eviction-soft="" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788660 5112 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788662 5112 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788665 5112 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788669 5112 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788672 5112 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788674 5112 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788677 5112 flags.go:64] FLAG: --feature-gates="" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788684 5112 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788687 5112 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788690 5112 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788693 5112 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788696 5112 flags.go:64] FLAG: --healthz-port="10248" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788699 5112 flags.go:64] FLAG: --help="false" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788702 5112 flags.go:64] FLAG: --hostname-override="ip-10-0-138-142.ec2.internal" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788705 5112 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788708 5112 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788711 5112 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788715 5112 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788719 5112 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788722 5112 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 23:35:11.795693 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788726 5112 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788730 5112 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788732 5112 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788735 5112 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788739 5112 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788741 5112 flags.go:64] FLAG: --kube-reserved="" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788745 5112 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788747 5112 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788750 5112 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788753 5112 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788756 5112 flags.go:64] FLAG: --lock-file="" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788759 5112 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788762 5112 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788765 5112 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788770 5112 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788773 5112 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788776 5112 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788779 5112 flags.go:64] FLAG: --logging-format="text" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788782 5112 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788785 5112 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788788 5112 flags.go:64] FLAG: --manifest-url="" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788791 5112 flags.go:64] FLAG: --manifest-url-header="" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788795 5112 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788799 5112 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788802 5112 flags.go:64] FLAG: --max-pods="110" Oct 30 23:35:11.796313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788805 5112 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788808 5112 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788811 5112 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788814 5112 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788818 5112 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788821 5112 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788824 5112 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788831 5112 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788835 5112 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788838 5112 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788841 5112 flags.go:64] FLAG: --pod-cidr="" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788844 5112 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788847 5112 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788850 5112 flags.go:64] FLAG: --pods-per-core="0" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788853 5112 flags.go:64] FLAG: --port="10250" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788856 5112 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788859 5112 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05cfafc999a216fe2" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788862 5112 flags.go:64] FLAG: --qos-reserved="" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788865 5112 flags.go:64] FLAG: --read-only-port="10255" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788868 5112 flags.go:64] FLAG: --register-node="true" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788871 5112 flags.go:64] FLAG: --register-with-taints="" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788875 5112 flags.go:64] FLAG: --registry-burst="10" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788878 5112 flags.go:64] FLAG: --registry-qps="5" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788881 5112 flags.go:64] FLAG: --reserved-cpus="" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788883 5112 flags.go:64] FLAG: --reserved-memory="" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788888 5112 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 23:35:11.796953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788891 5112 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788894 5112 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788897 5112 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788899 5112 flags.go:64] FLAG: --runonce="false" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788902 5112 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788905 5112 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788908 5112 flags.go:64] FLAG: --seccomp-default="false" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788911 5112 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788914 5112 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788917 5112 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788921 5112 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788924 5112 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788927 5112 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788930 5112 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788934 5112 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788937 5112 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788940 5112 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788943 5112 flags.go:64] FLAG: --system-cgroups="" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788946 5112 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788951 5112 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788953 5112 flags.go:64] FLAG: --tls-cert-file="" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788956 5112 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788960 5112 flags.go:64] FLAG: --tls-min-version="" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788963 5112 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788966 5112 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 23:35:11.797619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788968 5112 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788971 5112 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788974 5112 flags.go:64] FLAG: --v="2" Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788978 5112 flags.go:64] FLAG: --version="false" Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788982 5112 flags.go:64] FLAG: --vmodule="" Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788986 5112 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.788989 5112 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789122 5112 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789127 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789131 5112 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789134 5112 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789137 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789140 5112 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789143 5112 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789146 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789148 5112 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789151 5112 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789154 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789157 5112 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789160 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789162 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:11.798250 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789165 5112 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789168 5112 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789171 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789174 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789176 5112 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789179 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789182 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789184 5112 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789187 5112 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789189 5112 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789192 5112 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789194 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789197 5112 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789200 5112 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789203 5112 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789205 5112 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789208 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789210 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789213 5112 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789216 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:11.798760 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789218 5112 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789221 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789223 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789226 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789228 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789231 5112 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789233 5112 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789236 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789238 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789241 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789243 5112 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789247 5112 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789250 5112 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789253 5112 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789256 5112 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789259 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789261 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789264 5112 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789266 5112 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:11.799274 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789269 5112 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789271 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789274 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789276 5112 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789279 5112 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789282 5112 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789284 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789287 5112 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789289 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789292 5112 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789294 5112 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789297 5112 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789300 5112 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789302 5112 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789305 5112 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789308 5112 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789310 5112 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789312 5112 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789315 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789318 5112 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:11.799859 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789320 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789322 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789325 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789327 5112 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789330 5112 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789332 5112 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789335 5112 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789337 5112 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789340 5112 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789343 5112 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789346 5112 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789348 5112 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789350 5112 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789353 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789355 5112 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789358 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789363 5112 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789366 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789370 5112 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:11.800465 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789373 5112 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789377 5112 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789380 5112 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789382 5112 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789385 5112 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789387 5112 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789390 5112 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789393 5112 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789395 5112 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789398 5112 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789401 5112 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789403 5112 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789406 5112 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789408 5112 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.789433 5112 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789465 5112 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:11.801367 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789470 5112 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789473 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789476 5112 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789479 5112 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789482 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789485 5112 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789488 5112 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789491 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789493 5112 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789496 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789498 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789501 5112 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789504 5112 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789510 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789513 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789516 5112 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789519 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789521 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789524 5112 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789526 5112 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:11.802085 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789529 5112 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789531 5112 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789534 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789537 5112 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789540 5112 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789542 5112 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789545 5112 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789547 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789550 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789552 5112 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789555 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789558 5112 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789560 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789563 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789565 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789568 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789571 5112 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789573 5112 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789576 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:11.802687 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789581 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789584 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789587 5112 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789591 5112 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789594 5112 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789597 5112 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789602 5112 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789605 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789608 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789611 5112 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789614 5112 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789616 5112 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789619 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789622 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789625 5112 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789627 5112 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789630 5112 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789633 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789636 5112 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789638 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:11.803287 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789641 5112 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789643 5112 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789646 5112 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789649 5112 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789651 5112 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789655 5112 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789657 5112 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789660 5112 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789662 5112 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789665 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789667 5112 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789670 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789672 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789675 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789678 5112 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789680 5112 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789683 5112 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789685 5112 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789689 5112 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789693 5112 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:11.804137 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789695 5112 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789698 5112 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789701 5112 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789704 5112 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789706 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789709 5112 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789711 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789714 5112 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789716 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789720 5112 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789724 5112 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789728 5112 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789731 5112 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789733 5112 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789736 5112 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789738 5112 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789741 5112 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789744 5112 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789746 5112 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:11.804987 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789749 5112 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789752 5112 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789754 5112 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789757 5112 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789759 5112 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789762 5112 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.789765 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.794097 5112 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.794117 5112 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.794141 5112 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.794148 5112 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794319 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794326 5112 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794332 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794337 5112 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794341 5112 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794349 5112 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794363 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794367 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794372 5112 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:11.805886 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794376 5112 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794381 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794385 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794390 5112 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794395 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794399 5112 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794404 5112 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794408 5112 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794412 5112 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794422 5112 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794426 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794431 5112 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794435 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794440 5112 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794444 5112 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794449 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794454 5112 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794458 5112 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794463 5112 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:11.806777 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794468 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794474 5112 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794479 5112 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794488 5112 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794492 5112 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794497 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794501 5112 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794506 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794511 5112 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794515 5112 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794519 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794524 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794528 5112 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794532 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794537 5112 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794541 5112 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794550 5112 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794555 5112 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794559 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794563 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:11.807607 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794568 5112 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794572 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794577 5112 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794581 5112 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794586 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794590 5112 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794594 5112 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794599 5112 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794608 5112 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794613 5112 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794617 5112 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794621 5112 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794626 5112 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794631 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794636 5112 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794640 5112 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794644 5112 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794648 5112 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794653 5112 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:11.808599 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794657 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794661 5112 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794670 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794675 5112 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794679 5112 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794683 5112 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794690 5112 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794696 5112 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794701 5112 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794706 5112 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794710 5112 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794715 5112 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794719 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794724 5112 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794733 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794737 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794741 5112 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794746 5112 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794750 5112 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:11.809440 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794754 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794759 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794763 5112 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794767 5112 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794772 5112 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794776 5112 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794780 5112 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794785 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794794 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794799 5112 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794803 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794808 5112 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794812 5112 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794817 5112 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794821 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794825 5112 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794829 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794834 5112 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794838 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:11.810286 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.794842 5112 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.794893 5112 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795389 5112 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795401 5112 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795405 5112 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795408 5112 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795411 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795414 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795417 5112 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795419 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795422 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795425 5112 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795428 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795431 5112 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795433 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795436 5112 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:11.811120 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795439 5112 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795441 5112 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795443 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795446 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795449 5112 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795451 5112 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795454 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795458 5112 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795461 5112 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795464 5112 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795466 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795469 5112 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795472 5112 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795474 5112 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795477 5112 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795479 5112 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795482 5112 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795487 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795490 5112 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795494 5112 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:11.811847 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795497 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795500 5112 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795502 5112 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795506 5112 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795508 5112 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795511 5112 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795514 5112 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795517 5112 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795520 5112 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795522 5112 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795525 5112 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795528 5112 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795533 5112 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795544 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795549 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795552 5112 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795555 5112 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795558 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795560 5112 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795563 5112 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:11.812895 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795566 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795568 5112 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795571 5112 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795574 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795576 5112 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795579 5112 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795581 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795584 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795587 5112 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795589 5112 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795592 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795595 5112 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795598 5112 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795601 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795603 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795606 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795609 5112 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795619 5112 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795622 5112 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:11.814032 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795625 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795628 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795630 5112 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795633 5112 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795635 5112 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795638 5112 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795641 5112 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795643 5112 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795646 5112 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795649 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795652 5112 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795654 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795657 5112 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795659 5112 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795662 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795664 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795666 5112 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795669 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795671 5112 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795674 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:11.814887 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795676 5112 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795680 5112 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795682 5112 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795685 5112 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795687 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795690 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795693 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795695 5112 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795698 5112 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795702 5112 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795706 5112 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795710 5112 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795714 5112 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.795748 5112 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795784 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795787 5112 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:11.815832 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795791 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795794 5112 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795796 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795799 5112 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795801 5112 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795804 5112 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795806 5112 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795809 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795812 5112 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795814 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795817 5112 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795819 5112 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795823 5112 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795827 5112 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795830 5112 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795833 5112 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795835 5112 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795838 5112 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795841 5112 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795843 5112 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:11.816602 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795846 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795848 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795850 5112 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795853 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795855 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795858 5112 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795860 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795863 5112 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795866 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795869 5112 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795872 5112 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795874 5112 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795877 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795879 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795882 5112 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795884 5112 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795887 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795889 5112 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795892 5112 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:11.817617 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795894 5112 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795897 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795899 5112 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795902 5112 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795904 5112 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795907 5112 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795910 5112 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795912 5112 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795915 5112 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795917 5112 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795920 5112 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795922 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795925 5112 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795927 5112 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795930 5112 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795932 5112 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795935 5112 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795937 5112 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795940 5112 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795942 5112 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:11.818434 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795945 5112 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795947 5112 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795950 5112 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795955 5112 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795958 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795962 5112 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795966 5112 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795969 5112 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795972 5112 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795975 5112 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795978 5112 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795980 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795983 5112 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795985 5112 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795988 5112 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795990 5112 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795993 5112 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795995 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.795998 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:11.819308 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796000 5112 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796003 5112 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796005 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796008 5112 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796011 5112 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796013 5112 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796016 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796018 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796021 5112 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796023 5112 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796026 5112 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796028 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796031 5112 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796033 5112 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796036 5112 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796057 5112 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796061 5112 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796064 5112 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796066 5112 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:11.819812 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796071 5112 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796074 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796077 5112 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796079 5112 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796081 5112 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796084 5112 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:11.796087 5112 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.796143 5112 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.797083 5112 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.797138 5112 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.797307 5112 server.go:1014] "Starting client certificate rotation" Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.797443 5112 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.797502 5112 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 23:29:29 +0000 UTC" deadline="2028-04-16 04:52:32.439193556 +0000 UTC" Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.797548 5112 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12797h17m20.641648145s" Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.797777 5112 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.798796 5112 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 23:35:11.820562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.800204 5112 log.go:25] "Validated CRI v1 runtime API" Oct 30 23:35:11.821309 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.802272 5112 log.go:25] "Validated CRI v1 image API" Oct 30 23:35:11.821309 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.803059 5112 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 23:35:11.821309 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.805703 5112 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7d2e8b83-6351-48dc-97b7-79aa82cb0009:/dev/nvme0n1p3 de0527ee-ee33-4dc4-a33d-9fefbabf5d93:/dev/nvme0n1p4] Oct 30 23:35:11.821475 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.805732 5112 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/04977361d04dc89e93e27500a98d6879ee53efaff153014b50899597ec2d3568/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/04977361d04dc89e93e27500a98d6879ee53efaff153014b50899597ec2d3568/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/068755fea0a800e579ba10501284cad9faad5ebbbbffad453a4fca4004cde717/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/068755fea0a800e579ba10501284cad9faad5ebbbbffad453a4fca4004cde717/userdata/shm major:0 minor:70 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0a5671d5f669eac810a29bc6bfffa9de3f39d71b38dac381eb3000b977e02357/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0a5671d5f669eac810a29bc6bfffa9de3f39d71b38dac381eb3000b977e02357/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0f1cf5eeb80ca0ba62a0d6ce731ed8aefa3a00f7757a43d55f44aac4f59ced4c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0f1cf5eeb80ca0ba62a0d6ce731ed8aefa3a00f7757a43d55f44aac4f59ced4c/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/124faafc1ba1f051802269f7bb65bdba6d7bd3d519761c3b34bbdeb39b82edac/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/124faafc1ba1f051802269f7bb65bdba6d7bd3d519761c3b34bbdeb39b82edac/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/19e49b903e4ec8feb935e7992b2694f45944d5bc91916ad12270fd5ae3205eac/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/19e49b903e4ec8feb935e7992b2694f45944d5bc91916ad12270fd5ae3205eac/userdata/shm major:0 minor:338 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2a3a085850fe8c9a0179990cf36c32cc65d86884f0fc4aa5f98929a2ed684272/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2a3a085850fe8c9a0179990cf36c32cc65d86884f0fc4aa5f98929a2ed684272/userdata/shm major:0 minor:218 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/413b62b43bb849fce927766daa429b4c9702cb7e609628bb717157daa0189716/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/413b62b43bb849fce927766daa429b4c9702cb7e609628bb717157daa0189716/userdata/shm major:0 minor:220 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/427cdfa6f091964001512d0663a6c20f29afced2a3d068c041f2d3602fbcb191/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/427cdfa6f091964001512d0663a6c20f29afced2a3d068c041f2d3602fbcb191/userdata/shm major:0 minor:336 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/463522e03d08c17f36e838292c962e12315b942c7ac4f348f625ddf49ef0b608/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/463522e03d08c17f36e838292c962e12315b942c7ac4f348f625ddf49ef0b608/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/58757b0008ba867b2086eadb26788481e45832055b279909d6619130d9134d76/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/58757b0008ba867b2086eadb26788481e45832055b279909d6619130d9134d76/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/625fac24fdc042c956394079d46035621497e8cf7f132603b125b141d4fa300a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/625fac24fdc042c956394079d46035621497e8cf7f132603b125b141d4fa300a/userdata/shm major:0 minor:226 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/86137360f6a2b41e0a986d2cdff8c260694bd9c7099e54f0f20be50eb542409a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/86137360f6a2b41e0a986d2cdff8c260694bd9c7099e54f0f20be50eb542409a/userdata/shm major:0 minor:211 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8f50233a1793e5e33f6d9866170fafca59e1a6926c3d766eebb49a01835d7a6f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8f50233a1793e5e33f6d9866170fafca59e1a6926c3d766eebb49a01835d7a6f/userdata/shm major:0 minor:332 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/92046e6e9c5c4299c3ceb15421d8cce7035f2c05bbd68917b4202d7e3f4b5fe0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/92046e6e9c5c4299c3ceb15421d8cce7035f2c05bbd68917b4202d7e3f4b5fe0/userdata/shm major:0 minor:91 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/953f4e5ecd17a6e4d752561f96e273c037c838cf3c1491814ec235fdb2c77f3f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/953f4e5ecd17a6e4d752561f96e273c037c838cf3c1491814ec235fdb2c77f3f/userdata/shm major:0 minor:250 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/988486dce3f256714cfe3346a9788e386da2da5064aa8fe4d85ff7ab40642adb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/988486dce3f256714cfe3346a9788e386da2da5064aa8fe4d85ff7ab40642adb/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/993443a77d7d4821c6891068d3ccfad34f1aeb035db06115b7a4be54d074e2e1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/993443a77d7d4821c6891068d3ccfad34f1aeb035db06115b7a4be54d074e2e1/userdata/shm major:0 minor:329 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9eab77b969cfe6a38ff2e1adc053bdac9edf48a75e7d2033cd626f47db63b8e4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9eab77b969cfe6a38ff2e1adc053bdac9edf48a75e7d2033cd626f47db63b8e4/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a11c56075101b058a42fa52a8b4001c0c86f645b4ae466b89c29f23a0bc4e215/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a11c56075101b058a42fa52a8b4001c0c86f645b4ae466b89c29f23a0bc4e215/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/be290f49992e373865600cc32716fd055e83321974a3ce47df76130085909b22/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/be290f49992e373865600cc32716fd055e83321974a3ce47df76130085909b22/userdata/shm major:0 minor:254 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d4a9e0d78687e270dd440a298ac6acdcab977290d221bfabb06291bfef10d3fc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d4a9e0d78687e270dd440a298ac6acdcab977290d221bfabb06291bfef10d3fc/userdata/shm major:0 minor:222 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dac8de80811c6087e8cbdf9dba9d153ee108f1462b086ebb9de035c4ec95c3f3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dac8de80811c6087e8cbdf9dba9d153ee108f1462b086ebb9de035c4ec95c3f3/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f6fe21d35297426155014a540b350ba3eac1ad6b799958b5e36ad6dd8b6e5430/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f6fe21d35297426155014a540b350ba3eac1ad6b799958b5e36ad6dd8b6e5430/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fbc486c04618ab8d8b45584221593e060c3b9990e60db607e14d20f5e010dcfd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fbc486c04618ab8d8b45584221593e060c3b9990e60db607e14d20f5e010dcfd/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fc4e4cbf8e5f95b33f56216046b7882d56a7aa518db039a3f4a3c06c944d1b54/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fc4e4cbf8e5f95b33f56216046b7882d56a7aa518db039a3f4a3c06c944d1b54/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00f615e4-f815-49c8-b68d-23a95bc98a10/volumes/kubernetes.io~projected/kube-api-access-8rvsv:{mountpoint:/var/lib/kubelet/pods/00f615e4-f815-49c8-b68d-23a95bc98a10/volumes/kubernetes.io~projected/kube-api-access-8rvsv major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/05a8da7c-7313-471b-8437-fff42cdbda65/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/05a8da7c-7313-471b-8437-fff42cdbda65/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/05a8da7c-7313-471b-8437-fff42cdbda65/volumes/kubernetes.io~projected/kube-api-access-gjs9k:{mountpoint:/var/lib/kubelet/pods/05a8da7c-7313-471b-8437-fff42cdbda65/volumes/kubernetes.io~projected/kube-api-access-gjs9k major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/05a8da7c-7313-471b-8437-fff42cdbda65/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/05a8da7c-7313-471b-8437-fff42cdbda65/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/05a8da7c-7313-471b-8437-fff42cdbda65/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/05a8da7c-7313-471b-8437-fff42cdbda65/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2f5051b3-19d4-422e-a8d1-47129e287d57/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/2f5051b3-19d4-422e-a8d1-47129e287d57/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:238 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2f5051b3-19d4-422e-a8d1-47129e287d57/volumes/kubernetes.io~projected/kube-api-access-gpvhk:{mountpoint:/var/lib/kubelet/pods/2f5051b3-19d4-422e-a8d1-47129e287d57/volumes/kubernetes.io~projected/kube-api-access-gpvhk major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2f5051b3-19d4-422e-a8d1-47129e287d57/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/2f5051b3-19d4-422e-a8d1-47129e287d57/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:231 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2f5051b3-19d4-422e-a8d1-47129e287d57/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/2f5051b3-19d4-422e-a8d1-47129e287d57/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:232 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3549b0b4-488b-4819-b37a-8a566c3d5514/volumes/kubernetes.io~projected/kube-api-access-vtchh:{mountpoint:/var/lib/kubelet/pods/3549b0b4-488b-4819-b37a-8a566c3d5514/volumes/kubernetes.io~projected/kube-api-access-vtchh major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e87ca45-ff16-44e3-a360-5252e624f610/volumes/kubernetes.io~projected/kube-api-access-xb9b4:{mountpoint:/var/lib/kubelet/pods/3e87ca45-ff16-44e3-a360-5252e624f610/volumes/kubernetes.io~projected/kube-api-access-xb9b4 major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c7342b5-72f1-461d-8a00-eff0e377a4fe/volumes/kubernetes.io~projected/kube-api-access-fbpdj:{mountpoint:/var/lib/kubelet/pods/4c7342b5-72f1-461d-8a00-eff0e377a4fe/volumes/kubernetes.io~projected/kube-api-access-fbpdj major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5/volumes/kubernetes.io~projected/kube-api-access-27wgd:{mountpoint:/var/lib/kubelet/pods/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5/volumes/kubernetes.io~projected/kube-api-access-27wgd major:0 minor:239 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5/volumes/kubernetes.io~secret/cert major:0 minor:233 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/580f7210-4806-4d98-95c0-a1b2613c1222/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/580f7210-4806-4d98-95c0-a1b2613c1222/volumes/kubernetes.io~secret/agent-certs major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5d5343c7-fe93-4ee6-a987-d478c7801430/volumes/kubernetes.io~projected/kube-api-access-8zdn2:{mountpoint:/var/lib/kubelet/pods/5d5343c7-fe93-4ee6-a987-d478c7801430/volumes/kubernetes.io~projected/kube-api-access-8zdn2 major:0 minor:331 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5d5343c7-fe93-4ee6-a987-d478c7801430/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/5d5343c7-fe93-4ee6-a987-d478c7801430/volumes/kubernetes.io~secret/signing-key major:0 minor:328 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/65fcac23-a536-479c-b515-28fbc7711990/volumes/kubernetes.io~projected/kube-api-access-wzhwj:{mountpoint:/var/lib/kubelet/pods/65fcac23-a536-479c-b515-28fbc7711990/volumes/kubernetes.io~projected/kube-api-access-wzhwj major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/707fcc17-c66a-458e-bcb5-8b3558dbe8c4/volumes/kubernetes.io~projected/kube-api-access-5s667:{mountpoint:/var/lib/kubelet/pods/707fcc17-c66a-458e-bcb5-8b3558dbe8c4/volumes/kubernetes.io~projected/kube-api-access-5s667 major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/707fcc17-c66a-458e-bcb5-8b3558dbe8c4/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/707fcc17-c66a-458e-bcb5-8b3558dbe8c4/volumes/kubernetes.io~secret/serving-cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/72875bb8-4630-4ff6-bda6-19710347ae74/volumes/kubernetes.io~projected/kube-api-access-xz7nv:{mountpoint:/var/lib/kubelet/pods/72875bb8-4630-4ff6-bda6-19710347ae74/volumes/kubernetes.io~projected/kube-api-access-xz7nv major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/85f5885d-de4d-472f-aa8e-036454ea9a4d/volumes/kubernetes.io~projected/kube-api-access-6mfwz:{mountpoint:/var/lib/kubelet/pods/85f5885d-de4d-472f-aa8e-036454ea9a4d/volumes/kubernetes.io~projected/kube-api-access-6mfwz major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/85f5885d-de4d-472f-aa8e-036454ea9a4d/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/85f5885d-de4d-472f-aa8e-036454ea9a4d/volumes/kubernetes.io~secret/serving-cert major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8b2eb3ea-17b1-4cec-ab47-27be6876bf69/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/8b2eb3ea-17b1-4cec-ab47-27be6876bf69/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8b2eb3ea-17b1-4cec-ab47-27be6876bf69/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/8b2eb3ea-17b1-4cec-ab47-27be6876bf69/volumes/kubernetes.io~empty-dir/tmp major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8b2eb3ea-17b1-4cec-ab47-27be6876bf69/volumes/kubernetes.io~projected/kube-api-access-ff8p4:{mountpoint:/var/lib/kubelet/pods/8b2eb3ea-17b1-4cec-ab47-27be6876bf69/volumes/kubernetes.io~projected/kube-api-access-ff8p4 major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/931f746a-9d07-400d-9b4c-c16569e47a38/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/931f746a-9d07-400d-9b4c-c16569e47a38/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/931f746a-9d07-400d-9b4c-c16569e47a38/volumes/kubernetes.io~projected/kube-api-access-n8b2p:{mountpoint:/var/lib/kubelet/pods/931f746a-9d07-400d-9b4c-c16569e47a38/volumes/kubernetes.io~projected/kube-api-access-n8b2p major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/931f746a-9d07-400d-9b4c-c16569e47a38/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/931f746a-9d07-400d-9b4c-c16569e47a38/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/938e07e9-87b4-4618-87c0-b59bd13e7282/volumes/kubernetes.io~projected/kube-api-access-78sng:{mountpoint:/var/lib/kubelet/pods/938e07e9-87b4-4618-87c0-b59bd13e7282/volumes/kubernetes.io~projected/kube-api-access-78sng major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/969fd947-a81d-4e6a-b369-550efce8f665/volumes/kubernetes.io~projected/kube-api-access-b5j9g:{mountpoint:/var/lib/kubelet/pods/969fd947-a81d-4e6a-b369-550efce8f665/volumes/kubernetes.io~projected/kube-api-access-b5j9g major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9cb59a65-5d33-4842-abe0-582372433b12/volumes/kubernetes.io~projected/kube-api-access-h4pbv:{mountpoint:/var/lib/kubelet/pods/9cb59a65-5d33-4842-abe0-582372433b12/volumes/kubernetes.io~projected/kube-api-access-h4pbv major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9cb59a65-5d33-4842-abe0-582372433b12/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/9cb59a65-5d33-4842-abe0-582372433b12/volumes/kubernetes.io~secret/serving-cert major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb/volumes/kubernetes.io~projected/kube-api-access-fkbtl:{mountpoint:/var/lib/kubelet/pods/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb/volumes/kubernetes.io~projected/kube-api-access-fkbtl major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6/volumes/kubernetes.io~projected/kube-api-access-jkvqn:{mountpoint:/var/lib/kubelet/pods/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6/volumes/kubernetes.io~projected/kube-api-access-jkvqn major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6/volumes/kubernetes.io~secret/serving-cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ad6a30fe-07fa-48aa-92c3-4289c1066b37/volumes/kubernetes.io~projected/kube-api-access-rknsh:{mountpoint:/var/lib/kubelet/pods/ad6a30fe-07fa-48aa-92c3-4289c1066b37/volumes/kubernetes.io~projected/kube-api-access-rknsh major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d/volumes/kubernetes.io~projected/kube-api-access-h2wdw:{mountpoint:/var/lib/kubelet/pods/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d/volumes/kubernetes.io~projected/kube-api-access-h2wdw major:0 minor:237 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c5c08ca6-298f-4819-a28e-d4699cad5741/volumes/kubernetes.io~projected/kube-api-access-ts5mb:{mountpoint:/var/lib/kubelet/pods/c5c08ca6-298f-4819-a28e-d4699cad5741/volumes/kubernetes.io~projected/kube-api-access-ts5mb major:0 minor:322 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c9448c7a-5b0e-4ff7-808b-889a0d8b022f/volumes/kubernetes.io~projected/kube-api-access-c6ntz:{mountpoint:/var/lib/kubelet/pods/c9448c7a-5b0e-4ff7-808b-889a0d8b022f/volumes/kubernetes.io~projected/kube-api-access-c6ntz major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae/volumes/kubernetes.io~projected/kube-api-access-7kx9g:{mountpoint:/var/lib/kubelet/pods/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae/volumes/kubernetes.io~projected/kube-api-access-7kx9g major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ed39bbb9-fa16-45b9-98e4-84c920c6a5df/volumes/kubernetes.io~projected/kube-api-access-5vc5z:{mountpoint:/var/lib/kubelet/pods/ed39bbb9-fa16-45b9-98e4-84c920c6a5df/volumes/kubernetes.io~projected/kube-api-access-5vc5z major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/volumes/kubernetes.io~projected/kube-api-access-6trgt:{mountpoint:/var/lib/kubelet/pods/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/volumes/kubernetes.io~projected/kube-api-access-6trgt major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/volumes/kubernetes.io~secret/default-certificate major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/volumes/kubernetes.io~secret/stats-auth major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f2ba63b6-5f40-4d47-9b46-ec9f8888edce/volumes/kubernetes.io~projected/kube-api-access-zbtd2:{mountpoint:/var/lib/kubelet/pods/f2ba63b6-5f40-4d47-9b46-ec9f8888edce/volumes/kubernetes.io~projected/kube-api-access-zbtd2 major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fb41b0b9-c085-4343-be37-07f224fc4f8e/volumes/kubernetes.io~projected/kube-api-access-krsnz:{mountpoint:/var/lib/kubelet/pods/fb41b0b9-c085-4343-be37-07f224fc4f8e/volumes/kubernetes.io~projected/kube-api-access-krsnz major:0 minor:335 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fc6ae729-bb57-4d5f-9112-69dc5d0abee9/volumes/kubernetes.io~projected/kube-api-access-rj466:{mountpoint:/var/lib/kubelet/pods/fc6ae729-bb57-4d5f-9112-69dc5d0abee9/volumes/kubernetes.io~projected/kube-api-access-rj466 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fcf08154-6f21-453e-9028-7377db286d04/volumes/kubernetes.io~projected/kube-api-access-plhfv:{mountpoint:/var/lib/kubelet/pods/fcf08154-6f21-453e-9028-7377db286d04/volumes/kubernetes.io~projected/kube-api-access-plhfv major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ff7c1c2f-66d7-412e-b86c-a8502e575609/volumes/kubernetes.io~projected/kube-api-access-tbqzq:{mountpoint:/var/lib/kubelet/pods/ff7c1c2f-66d7-412e-b86c-a8502e575609/volumes/kubernetes.io~projected/kube-api-access-tbqzq major:0 minor:327 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/e3428b163166b40ad756a7fc61b4f4433c330f3fc6e4543423aa3abf46ad3833/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/3bf7561b1fdf5b754ffc05717384d67bb3c4b5dc3ab8f063f3bd601bb0b949e5/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/45e127d6519f4ec4f0b8da253c1e4dafe43a9bc866cc446628f9e11d53b276d0/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/0da4c82c45bad81bba3b85546fee298965efb43869b24fc88836502aecfced58/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/5c4df6a32e05fe9e376ad1141b3b22ab721823ac27d6cfcfb94218e0560c91c7/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/661ac5f233de557d3e184985e97dfe26b0bfd94072f400c4d58cd73307578cb2/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/a5eb4502452eef10ce32f00a68c718615e877e9ab6d75e6e643cf3c9a5194ea2/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/83124d56de64349479f0ad869735ed08372b8cf1f366baca055acca7851e1ba8/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/8d83271e6bb3d57f510a59390d057d416e164cd1732cf379cb131fbab90891a1/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/b2d121f56cea1a205ff5591117f5dd6f7b0a8487522aa5751d7257191da0750b/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/4012524d24850061283ff03cfa3eca645fb2a685005aab1cf894306386008300/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-143:{mountpoint:/var/lib/containers/storage/overlay/6d787695ff7e67149fd436feed92c82ec98256089f7665b0950f75be459110de/merged major:0 minor:143 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/155e8f1d97324044597fe2d48f5ac7aac4ada33b4b4302ed490fe82007e5c773/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/7aa14d8231ab71362e878000afce172e2ddb0407955c630ef0740984be183cb6/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/3862765c61c0d5cdc0a975e0f22237f437988c0842271d38fda8721b52be9b1c/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/0b38c8c3fe8e1792ce172d93a4af881500010514da5a8980a678782cc24dfaa0/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/a5f0a5e0b3ade85ba8f13355db841320d8f20aca073d0bac321931e9d2fd76a6/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/63770fcbd944fe213543ff898dd5c2e43f71cdfb231462dc53d3e2e450db1332/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/1491d37c23a209cf19381091a0cff6cafee3982f139ae69cc578cf47af653514/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/92e8b01dd549a644569d730b5375b8f398a8dbfc3f6f4c150363e120fcb2722c/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/3c1ee1ef800caf2fc4d8512774e58a4bc053308dd62801b52f7fa5f062bbe355/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-244:{mountpoint:/var/lib/containers/storage/overlay/b37993c0a366295bddd2e456400ae3a632780775d59ab3d3515615ba6f50361c/merged major:0 minor:244 fsType:overlay blockSize:0} overlay_0-246:{mountpoint:/var/lib/containers/storage/overlay/a697b2825c00746d65be708394da65f5a5cf0d09430acd14b0c26964f3a87efb/merged major:0 minor:246 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/d6bfee0ff857dc092b622d95cc7bcbe4b3df6e8afc48217d611c9195e5017c6c/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/8fbabc9ddad264b0d017fdfab9833489bd221404a255728f115c772130c2ff42/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/359b483f8bd885e64c7f5892bedfc184237c17a685835ae1cbdc83ee54583d0d/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-257:{mountpoint:/var/lib/containers/storage/overlay/629b896b63c77b949dc05866611f3a5b9e25f93eb668c2c32284873ab1b6e809/merged major:0 minor:257 fsType:overlay blockSize:0} overlay_0-259:{mountpoint:/var/lib/containers/storage/overlay/d3e035f5a1b0096abe4b0976d9375a9ad34816ed0a792a5d567e5bf53e176cb1/merged major:0 minor:259 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/e36e9ba60aaeb16680ae4c0d12825bfd46b9e0b01cb4b27e5441aaaa4e98f75b/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-263:{mountpoint:/var/lib/containers/storage/overlay/f947667b851a6448d4665bec7b442d2d8225d23f234fc58ed22fa2514d83bd9e/merged major:0 minor:263 fsType:overlay blockSize:0} overlay_0-270:{mountpoint:/var/lib/containers/storage/overlay/0a3d119c35b443fb28567a8bb00296861920d180f4d0bae38693dfad9ff60e6f/merged major:0 minor:270 fsType:overlay blockSize:0} overlay_0-276:{mountpoint:/var/lib/containers/storage/overlay/7cf7de92792d593e8ca05800aafc8570d5f0ee59cd153dbb6ffa862642c2f8f4/merged major:0 minor:276 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/7b8f01d678d4ae26cd025bac391168fb8ee53f16a938c648fe63a590de658c55/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-284:{mountpoint:/var/lib/containers/storage/overlay/00ebbe40ae67e0a72f3b820c5f2676ac4e1b1a2d53d49b2b477cb72731722b98/merged major:0 minor:284 fsType:overlay blockSize:0} overlay_0-286:{mountpoint:/var/lib/containers/storage/overlay/b3f126d4a2def79bff40378bec334147af75ba05285d8c1e6593cb904680d7b7/merged major:0 minor:286 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/a077c3f9bf3b6efd2528cc22f16e5003a751c4027ad8eea4fb1b43b200fd5307/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/6beb7388a63ab985dafed598e139f5e1c9df564ed3d27d7ecde51dec82893d4c/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/a77c10627c4821ccf50b42dce5bd1821f1beb42f3d95d33fa9ae73095474d603/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/3c6047a2e8b1f2b84e249ffcc8be54965011d479c5fb2bd24897777c0686118e/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/210c8cf0f226d2bb9054ca83f58a6124d98a1f99db98ef134f411a7169e459cc/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-312:{mountpoint:/var/lib/containers/storage/overlay/1638f92648dfc77c647484572239d7c5e534331b4f1caea542cdc5ac3007d0b7/merged major:0 minor:312 fsType:overlay blockSize:0} overlay_0-340:{mountpoint:/var/lib/containers/storage/overlay/d6d1e57b35670b7693f5d63725435b9efd6a3815551b86257711a9585af07f14/merged major:0 minor:340 fsType:overlay blockSize:0} overlay_0-342:{mountpoint:/var/lib/containers/storage/overlay/f78127d79eec66e2fa387d690ce215a5e72758a436925677c8e990416b6a134f/merged major:0 minor:342 fsType:overlay blockSize:0} overlay_0-344:{mountpoint:/var/lib/containers/storage/overlay/b6bef0fb7de73e476c57be88bd7c6d0b7176fe6425cb478dbcddbe90bd75982a/merged major:0 minor:344 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/2c0c4df1eff67047b9529c0ca4b800b8b960c50ca67579057c736a0499f3113c/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/7222230cecbdf3ccbe55dfbcd151fb36c60c939023e0bb3db0ea95527fcd9526/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/5d46f99643aff941b0b956e820ccc18e94bc27ebe3ea48d307cda61b1e383703/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-356:{mountpoint:/var/lib/containers/storage/overlay/e670ef8ec120a75b7690150dbd1dc1275114d24f74c83b8a7704196710bc1216/merged major:0 minor:356 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/6f24e2d6d9df2a094c9c19945ffd841ce431e24bb282473337e4a4230838b80f/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/30241c7fcfda828b8f44b0224556ef57bd560a65a24fb4c0ca93c4c062a26193/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/9dadcf96cfafa6480e08e1ad446bf134301906d63f64a378f13af15ea11c28a0/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-376:{mountpoint:/var/lib/containers/storage/overlay/1a518abff6d4781abf95def335912129e6d9320fa8b22fd127bb2596dfa342c3/merged major:0 minor:376 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/67eeab9824536b8e09c9a348a4690a14a91b409043219294e9e656a99651feac/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/6c50bee34669fd85f7286083501515103e7d1c482801cfcd9fa37e0829c97a1c/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/987819eb3e9b4a13486095c2f49926a6c413e64dcfd1296a06a36269eba08880/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/ee40bd98ed204d07ebe8d107590307bc5fb00a0925fc7225d195e331c2e4cc3d/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/05982259c45796efb97f62c5580d2ec214732778c1b00006dde11224083c27f6/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/983a4f59f815256b825750f51a0ddaa0e076eb08a2d9414cab36d58627281ed1/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/1efb8ad36e784270541f18cd9001a2364ed654853885947e02a4e1f6bc439b9b/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/ee084804d1282bf9d447dd2a3eb965626358a9e2ac778f5edf0c54c558a0d49f/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-95:{mountpoint:/var/lib/containers/storage/overlay/4705dc5edbd88a1bd1d0b1f1a0d3ec9a773d6e77a219db0f27ac84c762467098/merged major:0 minor:95 fsType:overlay blockSize:0} overlay_0-98:{mountpoint:/var/lib/containers/storage/overlay/15d07afb6ed11e4f557d62a135de18aaebba85110a791b80caecc22f5af88b94/merged major:0 minor:98 fsType:overlay blockSize:0}] Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.818427 5112 manager.go:217] Machine: {Timestamp:2026-10-30 23:35:11.817614299 +0000 UTC m=+0.081519862 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099539 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22abd6de4cf302434f9be6c9fccfcc SystemUUID:ec22abd6-de4c-f302-434f-9be6c9fccfcc BootID:5f712467-d18e-423d-938e-109621d5be9b Filesystems:[{Device:/var/lib/kubelet/pods/ed39bbb9-fa16-45b9-98e4-84c920c6a5df/volumes/kubernetes.io~projected/kube-api-access-5vc5z DeviceMajor:0 DeviceMinor:60 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c9448c7a-5b0e-4ff7-808b-889a0d8b022f/volumes/kubernetes.io~projected/kube-api-access-c6ntz DeviceMajor:0 DeviceMinor:62 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8b2eb3ea-17b1-4cec-ab47-27be6876bf69/volumes/kubernetes.io~projected/kube-api-access-ff8p4 DeviceMajor:0 DeviceMinor:64 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/19e49b903e4ec8feb935e7992b2694f45944d5bc91916ad12270fd5ae3205eac/userdata/shm DeviceMajor:0 DeviceMinor:338 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/580f7210-4806-4d98-95c0-a1b2613c1222/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:58 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d/volumes/kubernetes.io~projected/kube-api-access-h2wdw DeviceMajor:0 DeviceMinor:237 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-276 DeviceMajor:0 DeviceMinor:276 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-342 DeviceMajor:0 DeviceMinor:342 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/92046e6e9c5c4299c3ceb15421d8cce7035f2c05bbd68917b4202d7e3f4b5fe0/userdata/shm DeviceMajor:0 DeviceMinor:91 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-312 DeviceMajor:0 DeviceMinor:312 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/124faafc1ba1f051802269f7bb65bdba6d7bd3d519761c3b34bbdeb39b82edac/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:208 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2f5051b3-19d4-422e-a8d1-47129e287d57/volumes/kubernetes.io~projected/kube-api-access-gpvhk DeviceMajor:0 DeviceMinor:236 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8f50233a1793e5e33f6d9866170fafca59e1a6926c3d766eebb49a01835d7a6f/userdata/shm DeviceMajor:0 DeviceMinor:332 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/969fd947-a81d-4e6a-b369-550efce8f665/volumes/kubernetes.io~projected/kube-api-access-b5j9g DeviceMajor:0 DeviceMinor:59 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/4c7342b5-72f1-461d-8a00-eff0e377a4fe/volumes/kubernetes.io~projected/kube-api-access-fbpdj DeviceMajor:0 DeviceMinor:61 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/72875bb8-4630-4ff6-bda6-19710347ae74/volumes/kubernetes.io~projected/kube-api-access-xz7nv DeviceMajor:0 DeviceMinor:202 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/938e07e9-87b4-4618-87c0-b59bd13e7282/volumes/kubernetes.io~projected/kube-api-access-78sng DeviceMajor:0 DeviceMinor:203 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f2ba63b6-5f40-4d47-9b46-ec9f8888edce/volumes/kubernetes.io~projected/kube-api-access-zbtd2 DeviceMajor:0 DeviceMinor:228 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-257 DeviceMajor:0 DeviceMinor:257 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5d5343c7-fe93-4ee6-a987-d478c7801430/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:328 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae/volumes/kubernetes.io~projected/kube-api-access-7kx9g DeviceMajor:0 DeviceMinor:65 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0f1cf5eeb80ca0ba62a0d6ce731ed8aefa3a00f7757a43d55f44aac4f59ced4c/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb/volumes/kubernetes.io~projected/kube-api-access-fkbtl DeviceMajor:0 DeviceMinor:214 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-143 DeviceMajor:0 DeviceMinor:143 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/463522e03d08c17f36e838292c962e12315b942c7ac4f348f625ddf49ef0b608/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/931f746a-9d07-400d-9b4c-c16569e47a38/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/05a8da7c-7313-471b-8437-fff42cdbda65/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:210 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/volumes/kubernetes.io~projected/kube-api-access-6trgt DeviceMajor:0 DeviceMinor:213 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-376 DeviceMajor:0 DeviceMinor:376 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fc4e4cbf8e5f95b33f56216046b7882d56a7aa518db039a3f4a3c06c944d1b54/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/85f5885d-de4d-472f-aa8e-036454ea9a4d/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:224 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-244 DeviceMajor:0 DeviceMinor:244 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-263 DeviceMajor:0 DeviceMinor:263 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-340 DeviceMajor:0 DeviceMinor:340 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2f5051b3-19d4-422e-a8d1-47129e287d57/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:232 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/be290f49992e373865600cc32716fd055e83321974a3ce47df76130085909b22/userdata/shm DeviceMajor:0 DeviceMinor:254 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/931f746a-9d07-400d-9b4c-c16569e47a38/volumes/kubernetes.io~projected/kube-api-access-n8b2p DeviceMajor:0 DeviceMinor:63 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a11c56075101b058a42fa52a8b4001c0c86f645b4ae466b89c29f23a0bc4e215/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/625fac24fdc042c956394079d46035621497e8cf7f132603b125b141d4fa300a/userdata/shm DeviceMajor:0 DeviceMinor:226 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-259 DeviceMajor:0 DeviceMinor:259 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/8b2eb3ea-17b1-4cec-ab47-27be6876bf69/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:55 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:233 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5/volumes/kubernetes.io~projected/kube-api-access-27wgd DeviceMajor:0 DeviceMinor:239 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/707fcc17-c66a-458e-bcb5-8b3558dbe8c4/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:45 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9cb59a65-5d33-4842-abe0-582372433b12/volumes/kubernetes.io~projected/kube-api-access-h4pbv DeviceMajor:0 DeviceMinor:216 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/05a8da7c-7313-471b-8437-fff42cdbda65/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:217 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/427cdfa6f091964001512d0663a6c20f29afced2a3d068c041f2d3602fbcb191/userdata/shm DeviceMajor:0 DeviceMinor:336 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/65fcac23-a536-479c-b515-28fbc7711990/volumes/kubernetes.io~projected/kube-api-access-wzhwj DeviceMajor:0 DeviceMinor:66 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/707fcc17-c66a-458e-bcb5-8b3558dbe8c4/volumes/kubernetes.io~projected/kube-api-access-5s667 DeviceMajor:0 DeviceMinor:205 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-286 DeviceMajor:0 DeviceMinor:286 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/05a8da7c-7313-471b-8437-fff42cdbda65/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:207 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/ad6a30fe-07fa-48aa-92c3-4289c1066b37/volumes/kubernetes.io~projected/kube-api-access-rknsh DeviceMajor:0 DeviceMinor:225 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2f5051b3-19d4-422e-a8d1-47129e287d57/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:238 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8b2eb3ea-17b1-4cec-ab47-27be6876bf69/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:57 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/00f615e4-f815-49c8-b68d-23a95bc98a10/volumes/kubernetes.io~projected/kube-api-access-8rvsv DeviceMajor:0 DeviceMinor:201 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/86137360f6a2b41e0a986d2cdff8c260694bd9c7099e54f0f20be50eb542409a/userdata/shm DeviceMajor:0 DeviceMinor:211 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2a3a085850fe8c9a0179990cf36c32cc65d86884f0fc4aa5f98929a2ed684272/userdata/shm DeviceMajor:0 DeviceMinor:218 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dac8de80811c6087e8cbdf9dba9d153ee108f1462b086ebb9de035c4ec95c3f3/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/068755fea0a800e579ba10501284cad9faad5ebbbbffad453a4fca4004cde717/userdata/shm DeviceMajor:0 DeviceMinor:70 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9eab77b969cfe6a38ff2e1adc053bdac9edf48a75e7d2033cd626f47db63b8e4/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-98 DeviceMajor:0 DeviceMinor:98 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:197 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-270 DeviceMajor:0 DeviceMinor:270 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/988486dce3f256714cfe3346a9788e386da2da5064aa8fe4d85ff7ab40642adb/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/953f4e5ecd17a6e4d752561f96e273c037c838cf3c1491814ec235fdb2c77f3f/userdata/shm DeviceMajor:0 DeviceMinor:250 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/5d5343c7-fe93-4ee6-a987-d478c7801430/volumes/kubernetes.io~projected/kube-api-access-8zdn2 DeviceMajor:0 DeviceMinor:331 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/9cb59a65-5d33-4842-abe0-582372433b12/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:206 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/993443a77d7d4821c6891068d3ccfad34f1aeb035db06115b7a4be54d074e2e1/userdata/shm DeviceMajor:0 DeviceMinor:329 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3e87ca45-ff16-44e3-a360-5252e624f610/volumes/kubernetes.io~projected/kube-api-access-xb9b4 DeviceMajor:0 DeviceMinor:293 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/3549b0b4-488b-4819-b37a-8a566c3d5514/volumes/kubernetes.io~projected/kube-api-access-vtchh DeviceMajor:0 DeviceMinor:334 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/04977361d04dc89e93e27500a98d6879ee53efaff153014b50899597ec2d3568/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ff7c1c2f-66d7-412e-b86c-a8502e575609/volumes/kubernetes.io~projected/kube-api-access-tbqzq DeviceMajor:0 DeviceMinor:327 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f6fe21d35297426155014a540b350ba3eac1ad6b799958b5e36ad6dd8b6e5430/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:288 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-356 DeviceMajor:0 DeviceMinor:356 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/58757b0008ba867b2086eadb26788481e45832055b279909d6619130d9134d76/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/931f746a-9d07-400d-9b4c-c16569e47a38/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:209 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/05a8da7c-7313-471b-8437-fff42cdbda65/volumes/kubernetes.io~projected/kube-api-access-gjs9k DeviceMajor:0 DeviceMinor:215 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/413b62b43bb849fce927766daa429b4c9702cb7e609628bb717157daa0189716/userdata/shm DeviceMajor:0 DeviceMinor:220 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d4a9e0d78687e270dd440a298ac6acdcab977290d221bfabb06291bfef10d3fc/userdata/shm DeviceMajor:0 DeviceMinor:222 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-284 DeviceMajor:0 DeviceMinor:284 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fcf08154-6f21-453e-9028-7377db286d04/volumes/kubernetes.io~projected/kube-api-access-plhfv DeviceMajor:0 DeviceMinor:227 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/85f5885d-de4d-472f-aa8e-036454ea9a4d/volumes/kubernetes.io~projected/kube-api-access-6mfwz DeviceMajor:0 DeviceMinor:230 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c5c08ca6-298f-4819-a28e-d4699cad5741/volumes/kubernetes.io~projected/kube-api-access-ts5mb DeviceMajor:0 DeviceMinor:322 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2f5051b3-19d4-422e-a8d1-47129e287d57/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:231 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-246 DeviceMajor:0 DeviceMinor:246 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-344 DeviceMajor:0 DeviceMinor:344 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-95 DeviceMajor:0 DeviceMinor:95 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6/volumes/kubernetes.io~projected/kube-api-access-jkvqn DeviceMajor:0 DeviceMinor:204 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fbc486c04618ab8d8b45584221593e060c3b9990e60db607e14d20f5e010dcfd/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0a5671d5f669eac810a29bc6bfffa9de3f39d71b38dac381eb3000b977e02357/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fc6ae729-bb57-4d5f-9112-69dc5d0abee9/volumes/kubernetes.io~projected/kube-api-access-rj466 DeviceMajor:0 DeviceMinor:67 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/fb41b0b9-c085-4343-be37-07f224fc4f8e/volumes/kubernetes.io~projected/kube-api-access-krsnz DeviceMajor:0 DeviceMinor:335 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:04977361d04dc89 MacAddress:1e:5d:05:6a:c8:7c Speed:10000 Mtu:8901} {Name:0a5671d5f669eac MacAddress:3a:95:50:5f:3b:fb Speed:10000 Mtu:8901} {Name:19e49b903e4ec8f MacAddress:ca:49:70:50:30:b9 Speed:10000 Mtu:8901} {Name:2a3a085850fe8c9 MacAddress:ba:96:45:73:96:14 Speed:10000 Mtu:8901} {Name:413b62b43bb849f MacAddress:0a:54:0e:f8:33:6e Speed:10000 Mtu:8901} {Name:427cdfa6f091964 MacAddress:7a:83:a1:2f:0b:a8 Speed:10000 Mtu:8901} {Name:463522e03d08c17 MacAddress:8a:a9:4d:dd:32:9e Speed:10000 Mtu:8901} {Name:625fac24fdc042c MacAddress:a6:b6:8e:9c:16:6d Speed:10000 Mtu:8901} {Name:86137360f6a2b41 MacAddress:ba:a8:e9:cc:a6:dd Speed:10000 Mtu:8901} {Name:8f50233a1793e5e MacAddress:3a:80:ff:fc:3d:29 Speed:10000 Mtu:8901} {Name:953f4e5ecd17a6e MacAddress:d6:51:25:8b:32:c5 Speed:10000 Mtu:8901} {Name:993443a77d7d482 MacAddress:56:17:66:cf:bb:dc Speed:10000 Mtu:8901} {Name:be290f49992e373 MacAddress:f2:2a:4a:1d:24:36 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:d9:68:f9:65 Speed:0 Mtu:9001} {Name:br-int MacAddress:ba:f3:16:fd:4a:e3 Speed:0 Mtu:8901} {Name:d4a9e0d78687e27 MacAddress:ae:7f:20:d8:e4:12 Speed:10000 Mtu:8901} {Name:dac8de80811c608 MacAddress:ba:cd:fe:4d:f4:32 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:d9:68:f9:65 Speed:0 Mtu:9001} {Name:fbc486c04618ab8 MacAddress:56:c5:a5:e5:b0:f8 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:fe:d1:56:83:cf:ed Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:d2:7c:46:81:28:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819098 5112 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819153 5112 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819435 5112 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819461 5112 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-142.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819581 5112 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819589 5112 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819602 5112 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819614 5112 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819632 5112 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819776 5112 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819899 5112 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819930 5112 kubelet.go:493] "Attempting to sync node with API server" Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819943 5112 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819951 5112 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819960 5112 kubelet.go:405] "Adding apiserver pod source" Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.819967 5112 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.820585 5112 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.820593 5112 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 23:35:11.821905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.821110 5112 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 23:35:11.823275 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823260 5112 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 23:35:11.823275 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823273 5112 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 23:35:11.823376 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823366 5112 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 30 23:35:11.823550 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823531 5112 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 23:35:11.823610 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823566 5112 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 23:35:11.823671 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823661 5112 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 23:35:11.823724 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823676 5112 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 23:35:11.823724 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823683 5112 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 23:35:11.823724 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823688 5112 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 23:35:11.823724 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823694 5112 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 23:35:11.823724 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823704 5112 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 23:35:11.823724 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823713 5112 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 23:35:11.823724 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823721 5112 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 23:35:11.823724 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823727 5112 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 23:35:11.824150 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823732 5112 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 23:35:11.824150 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823751 5112 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 23:35:11.824150 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823760 5112 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 23:35:11.824150 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823786 5112 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 23:35:11.824150 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.823793 5112 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 23:35:11.827260 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.827247 5112 server.go:1263] "Started kubelet" Oct 30 23:35:11.827339 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.827314 5112 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 23:35:11.827489 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.827415 5112 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 23:35:11.827567 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.827508 5112 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 23:35:11.827762 ip-10-0-138-142 systemd[1]: Started Kubernetes Kubelet. Oct 30 23:35:11.829248 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.827885 5112 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 23:35:11.829248 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.828523 5112 server.go:317] "Adding debug handlers to kubelet server" Oct 30 23:35:11.836162 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.836146 5112 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 23:35:11.836240 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.836196 5112 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 23:35:11.836291 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.836239 5112 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 23:29:31 +0000 UTC" deadline="2028-08-02 05:00:43.946128294 +0000 UTC" Oct 30 23:35:11.836291 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.836257 5112 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15389h25m32.109873834s" Oct 30 23:35:11.836424 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:11.836307 5112 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-142.ec2.internal\" not found" Oct 30 23:35:11.837566 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.837523 5112 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 23:35:11.838153 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.838124 5112 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 23:35:11.838153 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.838141 5112 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 23:35:11.838288 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.838177 5112 factory.go:153] Registering CRI-O factory Oct 30 23:35:11.838288 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.838194 5112 factory.go:223] Registration of the crio container factory successfully Oct 30 23:35:11.838288 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.838244 5112 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 23:35:11.838288 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.838255 5112 factory.go:55] Registering systemd factory Oct 30 23:35:11.838288 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.838263 5112 factory.go:223] Registration of the systemd container factory successfully Oct 30 23:35:11.838288 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.838278 5112 factory.go:103] Registering Raw factory Oct 30 23:35:11.838288 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.838291 5112 manager.go:1199] Started watching for new ooms in manager Oct 30 23:35:11.838636 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.838618 5112 manager.go:319] Starting recovery of all containers Oct 30 23:35:11.841398 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841354 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2f5051b3-19d4-422e-a8d1-47129e287d57" volumeName="kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-bound-sa-token" seLinuxMountContext="" Oct 30 23:35:11.841465 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841403 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="65fcac23-a536-479c-b515-28fbc7711990" volumeName="kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-cni-sysctl-allowlist" seLinuxMountContext="" Oct 30 23:35:11.841465 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841420 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="931f746a-9d07-400d-9b4c-c16569e47a38" volumeName="kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-ovnkube-script-lib" seLinuxMountContext="" Oct 30 23:35:11.841465 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841434 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4" volumeName="kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-stats-auth" seLinuxMountContext="" Oct 30 23:35:11.841465 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841447 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc6ae729-bb57-4d5f-9112-69dc5d0abee9" volumeName="kubernetes.io/empty-dir/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-tmp-dir" seLinuxMountContext="" Oct 30 23:35:11.841465 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841460 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9cb59a65-5d33-4842-abe0-582372433b12" volumeName="kubernetes.io/projected/9cb59a65-5d33-4842-abe0-582372433b12-kube-api-access-h4pbv" seLinuxMountContext="" Oct 30 23:35:11.841607 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841473 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9cb59a65-5d33-4842-abe0-582372433b12" volumeName="kubernetes.io/secret/9cb59a65-5d33-4842-abe0-582372433b12-serving-cert" seLinuxMountContext="" Oct 30 23:35:11.841607 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841486 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb41b0b9-c085-4343-be37-07f224fc4f8e" volumeName="kubernetes.io/configmap/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-rbac-proxy-cm" seLinuxMountContext="" Oct 30 23:35:11.841607 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841501 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05a8da7c-7313-471b-8437-fff42cdbda65" volumeName="kubernetes.io/empty-dir/05a8da7c-7313-471b-8437-fff42cdbda65-ca-trust-extracted" seLinuxMountContext="" Oct 30 23:35:11.841607 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841513 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05a8da7c-7313-471b-8437-fff42cdbda65" volumeName="kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-installation-pull-secrets" seLinuxMountContext="" Oct 30 23:35:11.841607 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841524 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d" volumeName="kubernetes.io/projected/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-kube-api-access-h2wdw" seLinuxMountContext="" Oct 30 23:35:11.841607 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841535 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4" volumeName="kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-default-certificate" seLinuxMountContext="" Oct 30 23:35:11.841607 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841546 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2ba63b6-5f40-4d47-9b46-ec9f8888edce" volumeName="kubernetes.io/projected/f2ba63b6-5f40-4d47-9b46-ec9f8888edce-kube-api-access-zbtd2" seLinuxMountContext="" Oct 30 23:35:11.841607 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841557 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2f5051b3-19d4-422e-a8d1-47129e287d57" volumeName="kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-kube-api-access-gpvhk" seLinuxMountContext="" Oct 30 23:35:11.841607 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841572 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2f5051b3-19d4-422e-a8d1-47129e287d57" volumeName="kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-installation-pull-secrets" seLinuxMountContext="" Oct 30 23:35:11.841607 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841583 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3549b0b4-488b-4819-b37a-8a566c3d5514" volumeName="kubernetes.io/projected/3549b0b4-488b-4819-b37a-8a566c3d5514-kube-api-access-vtchh" seLinuxMountContext="" Oct 30 23:35:11.841607 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841594 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5d5343c7-fe93-4ee6-a987-d478c7801430" volumeName="kubernetes.io/secret/5d5343c7-fe93-4ee6-a987-d478c7801430-signing-key" seLinuxMountContext="" Oct 30 23:35:11.841607 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841607 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85f5885d-de4d-472f-aa8e-036454ea9a4d" volumeName="kubernetes.io/secret/85f5885d-de4d-472f-aa8e-036454ea9a4d-serving-cert" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841618 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed39bbb9-fa16-45b9-98e4-84c920c6a5df" volumeName="kubernetes.io/projected/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-kube-api-access-5vc5z" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841629 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00f615e4-f815-49c8-b68d-23a95bc98a10" volumeName="kubernetes.io/projected/00f615e4-f815-49c8-b68d-23a95bc98a10-kube-api-access-8rvsv" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841640 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05a8da7c-7313-471b-8437-fff42cdbda65" volumeName="kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-kube-api-access-gjs9k" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841651 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1302dd34-a67e-4861-96d8-1b98c2d2e314" volumeName="kubernetes.io/configmap/1302dd34-a67e-4861-96d8-1b98c2d2e314-nginx-conf" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841711 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="65fcac23-a536-479c-b515-28fbc7711990" volumeName="kubernetes.io/projected/65fcac23-a536-479c-b515-28fbc7711990-kube-api-access-wzhwj" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841723 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b2eb3ea-17b1-4cec-ab47-27be6876bf69" volumeName="kubernetes.io/empty-dir/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-tmp" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841734 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9cb59a65-5d33-4842-abe0-582372433b12" volumeName="kubernetes.io/configmap/9cb59a65-5d33-4842-abe0-582372433b12-service-ca-bundle" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841745 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d" volumeName="kubernetes.io/configmap/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-config-volume" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841757 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d" volumeName="kubernetes.io/empty-dir/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-tmp-dir" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841788 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="65fcac23-a536-479c-b515-28fbc7711990" volumeName="kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841807 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85f5885d-de4d-472f-aa8e-036454ea9a4d" volumeName="kubernetes.io/configmap/85f5885d-de4d-472f-aa8e-036454ea9a4d-config" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841818 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9cb59a65-5d33-4842-abe0-582372433b12" volumeName="kubernetes.io/empty-dir/9cb59a65-5d33-4842-abe0-582372433b12-snapshots" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841838 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6" volumeName="kubernetes.io/secret/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-serving-cert" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841850 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fcf08154-6f21-453e-9028-7377db286d04" volumeName="kubernetes.io/projected/fcf08154-6f21-453e-9028-7377db286d04-kube-api-access-plhfv" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841863 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3549b0b4-488b-4819-b37a-8a566c3d5514" volumeName="kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-service-ca-bundle" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841875 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" volumeName="kubernetes.io/secret/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-serving-cert" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841888 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c5c08ca6-298f-4819-a28e-d4699cad5741" volumeName="kubernetes.io/projected/c5c08ca6-298f-4819-a28e-d4699cad5741-kube-api-access-ts5mb" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841903 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c9448c7a-5b0e-4ff7-808b-889a0d8b022f" volumeName="kubernetes.io/projected/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-kube-api-access-c6ntz" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841914 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc6ae729-bb57-4d5f-9112-69dc5d0abee9" volumeName="kubernetes.io/projected/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-kube-api-access-rj466" seLinuxMountContext="" Oct 30 23:35:11.841923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841926 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05a8da7c-7313-471b-8437-fff42cdbda65" volumeName="kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-registry-certificates" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841938 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3549b0b4-488b-4819-b37a-8a566c3d5514" volumeName="kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-trusted-ca-bundle" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841950 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6" volumeName="kubernetes.io/configmap/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-config" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841961 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae" volumeName="kubernetes.io/projected/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-kube-api-access-7kx9g" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841972 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="65fcac23-a536-479c-b515-28fbc7711990" volumeName="kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-cni-binary-copy" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841983 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="938e07e9-87b4-4618-87c0-b59bd13e7282" volumeName="kubernetes.io/projected/938e07e9-87b4-4618-87c0-b59bd13e7282-kube-api-access-78sng" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.841994 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a89e6ed3-bb09-4d7f-85cb-092cd129b7bb" volumeName="kubernetes.io/configmap/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-config" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842005 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ff7c1c2f-66d7-412e-b86c-a8502e575609" volumeName="kubernetes.io/projected/ff7c1c2f-66d7-412e-b86c-a8502e575609-kube-api-access-tbqzq" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842018 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e87ca45-ff16-44e3-a360-5252e624f610" volumeName="kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842028 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5" volumeName="kubernetes.io/secret/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5-cert" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842055 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="72875bb8-4630-4ff6-bda6-19710347ae74" volumeName="kubernetes.io/projected/72875bb8-4630-4ff6-bda6-19710347ae74-kube-api-access-xz7nv" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842067 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b2eb3ea-17b1-4cec-ab47-27be6876bf69" volumeName="kubernetes.io/empty-dir/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-tuned" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842079 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="969fd947-a81d-4e6a-b369-550efce8f665" volumeName="kubernetes.io/projected/969fd947-a81d-4e6a-b369-550efce8f665-kube-api-access-b5j9g" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842091 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a89e6ed3-bb09-4d7f-85cb-092cd129b7bb" volumeName="kubernetes.io/projected/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-kube-api-access-fkbtl" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842102 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3549b0b4-488b-4819-b37a-8a566c3d5514" volumeName="kubernetes.io/empty-dir/3549b0b4-488b-4819-b37a-8a566c3d5514-archives-path" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842114 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5d5343c7-fe93-4ee6-a987-d478c7801430" volumeName="kubernetes.io/projected/5d5343c7-fe93-4ee6-a987-d478c7801430-kube-api-access-8zdn2" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842125 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9cb59a65-5d33-4842-abe0-582372433b12" volumeName="kubernetes.io/configmap/9cb59a65-5d33-4842-abe0-582372433b12-trusted-ca-bundle" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842136 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9cb59a65-5d33-4842-abe0-582372433b12" volumeName="kubernetes.io/empty-dir/9cb59a65-5d33-4842-abe0-582372433b12-tmp" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842146 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed39bbb9-fa16-45b9-98e4-84c920c6a5df" volumeName="kubernetes.io/configmap/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-cni-binary-copy" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842176 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb41b0b9-c085-4343-be37-07f224fc4f8e" volumeName="kubernetes.io/empty-dir/fb41b0b9-c085-4343-be37-07f224fc4f8e-data-volume" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842188 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="580f7210-4806-4d98-95c0-a1b2613c1222" volumeName="kubernetes.io/secret/580f7210-4806-4d98-95c0-a1b2613c1222-agent-certs" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842199 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05a8da7c-7313-471b-8437-fff42cdbda65" volumeName="kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-trusted-ca" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842211 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5" volumeName="kubernetes.io/projected/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5-kube-api-access-27wgd" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842223 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="580f7210-4806-4d98-95c0-a1b2613c1222" volumeName="kubernetes.io/configmap/580f7210-4806-4d98-95c0-a1b2613c1222-konnectivity-ca" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842242 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" volumeName="kubernetes.io/projected/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-kube-api-access-5s667" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842255 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6" volumeName="kubernetes.io/projected/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-kube-api-access-jkvqn" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842266 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad6a30fe-07fa-48aa-92c3-4289c1066b37" volumeName="kubernetes.io/projected/ad6a30fe-07fa-48aa-92c3-4289c1066b37-kube-api-access-rknsh" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842277 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed39bbb9-fa16-45b9-98e4-84c920c6a5df" volumeName="kubernetes.io/configmap/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-daemon-config" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842290 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2f5051b3-19d4-422e-a8d1-47129e287d57" volumeName="kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-image-registry-private-configuration" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842308 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c7342b5-72f1-461d-8a00-eff0e377a4fe" volumeName="kubernetes.io/projected/4c7342b5-72f1-461d-8a00-eff0e377a4fe-kube-api-access-fbpdj" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842320 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" volumeName="kubernetes.io/configmap/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-trusted-ca" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842332 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="931f746a-9d07-400d-9b4c-c16569e47a38" volumeName="kubernetes.io/projected/931f746a-9d07-400d-9b4c-c16569e47a38-kube-api-access-n8b2p" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842344 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="931f746a-9d07-400d-9b4c-c16569e47a38" volumeName="kubernetes.io/secret/931f746a-9d07-400d-9b4c-c16569e47a38-ovn-node-metrics-cert" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842355 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="938e07e9-87b4-4618-87c0-b59bd13e7282" volumeName="kubernetes.io/configmap/938e07e9-87b4-4618-87c0-b59bd13e7282-telemetry-config" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842367 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae" volumeName="kubernetes.io/configmap/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-iptables-alerter-script" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842380 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2f5051b3-19d4-422e-a8d1-47129e287d57" volumeName="kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-trusted-ca" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842393 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2f5051b3-19d4-422e-a8d1-47129e287d57" volumeName="kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-certificates" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842405 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91" volumeName="kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842416 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5d5343c7-fe93-4ee6-a987-d478c7801430" volumeName="kubernetes.io/configmap/5d5343c7-fe93-4ee6-a987-d478c7801430-signing-cabundle" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842427 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b2eb3ea-17b1-4cec-ab47-27be6876bf69" volumeName="kubernetes.io/projected/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-kube-api-access-ff8p4" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842438 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05a8da7c-7313-471b-8437-fff42cdbda65" volumeName="kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-image-registry-private-configuration" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842448 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" volumeName="kubernetes.io/configmap/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-config" seLinuxMountContext="" Oct 30 23:35:11.842444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842459 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85f5885d-de4d-472f-aa8e-036454ea9a4d" volumeName="kubernetes.io/projected/85f5885d-de4d-472f-aa8e-036454ea9a4d-kube-api-access-6mfwz" seLinuxMountContext="" Oct 30 23:35:11.844188 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842472 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="931f746a-9d07-400d-9b4c-c16569e47a38" volumeName="kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-env-overrides" seLinuxMountContext="" Oct 30 23:35:11.844188 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842484 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="931f746a-9d07-400d-9b4c-c16569e47a38" volumeName="kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-ovnkube-config" seLinuxMountContext="" Oct 30 23:35:11.844188 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842510 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c9448c7a-5b0e-4ff7-808b-889a0d8b022f" volumeName="kubernetes.io/configmap/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-serviceca" seLinuxMountContext="" Oct 30 23:35:11.844188 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842521 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4" volumeName="kubernetes.io/projected/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-kube-api-access-6trgt" seLinuxMountContext="" Oct 30 23:35:11.844188 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842532 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb41b0b9-c085-4343-be37-07f224fc4f8e" volumeName="kubernetes.io/projected/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-api-access-krsnz" seLinuxMountContext="" Oct 30 23:35:11.844188 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842543 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05a8da7c-7313-471b-8437-fff42cdbda65" volumeName="kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-bound-sa-token" seLinuxMountContext="" Oct 30 23:35:11.844188 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842556 5112 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2f5051b3-19d4-422e-a8d1-47129e287d57" volumeName="kubernetes.io/empty-dir/2f5051b3-19d4-422e-a8d1-47129e287d57-ca-trust-extracted" seLinuxMountContext="" Oct 30 23:35:11.844188 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842568 5112 reconstruct.go:97] "Volume reconstruction finished" Oct 30 23:35:11.844188 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.842577 5112 reconciler.go:29] "Reconciler: start to sync state" Oct 30 23:35:11.866179 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.866123 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/1.log" Oct 30 23:35:11.866937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.866910 5112 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 23:35:11.868398 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.868376 5112 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 23:35:11.868398 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.868394 5112 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 23:35:11.868510 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.868410 5112 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 23:35:11.868510 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:11.868454 5112 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 30 23:35:11.868789 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.868766 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/1.log" Oct 30 23:35:11.873818 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.873797 5112 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 30 23:35:11.876685 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.876663 5112 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:35:11.876804 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.876741 5112 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:35:11.877714 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.877691 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/1.log" Oct 30 23:35:11.877807 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.877728 5112 generic.go:356] "Generic (PLEG): container finished" podID="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" containerID="3ea4b50601647a9ba5327b72953a23ad0585b88fc5790b48a10ea397a9a5779a" exitCode=255 Oct 30 23:35:11.888273 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.888253 5112 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:35:11.891912 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.891885 5112 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:35:11.896013 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.895981 5112 generic.go:356] "Generic (PLEG): container finished" podID="65fcac23-a536-479c-b515-28fbc7711990" containerID="4522c44acac5872d8d38202e226bfaaca76f303d5e976f5ba76687b76dce4eb7" exitCode=0 Oct 30 23:35:11.896013 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.896001 5112 generic.go:356] "Generic (PLEG): container finished" podID="65fcac23-a536-479c-b515-28fbc7711990" containerID="ea2b24f1e4239484b244f9a622ebe8ddc4aefc2d68ff990e096d52fb48173daf" exitCode=0 Oct 30 23:35:11.896013 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.896011 5112 generic.go:356] "Generic (PLEG): container finished" podID="65fcac23-a536-479c-b515-28fbc7711990" containerID="da5c0d508e6016124885542b192fa75614ba4fd847e28ee63c88ed5ed7add294" exitCode=0 Oct 30 23:35:11.896232 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.896022 5112 generic.go:356] "Generic (PLEG): container finished" podID="65fcac23-a536-479c-b515-28fbc7711990" containerID="09c797f3e573ff1d21b4e514245525f049be47f14dd7bb62171d97372d0f41f1" exitCode=0 Oct 30 23:35:11.896232 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.896030 5112 generic.go:356] "Generic (PLEG): container finished" podID="65fcac23-a536-479c-b515-28fbc7711990" containerID="e044245be40edb013c18c4a765ce0733f52524279f7fa2531af11cfeae2716fb" exitCode=0 Oct 30 23:35:11.896232 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.896057 5112 generic.go:356] "Generic (PLEG): container finished" podID="65fcac23-a536-479c-b515-28fbc7711990" containerID="e31d5b94d25620d4bc4bdc784952922f4e80a9599a3412e830fdd52965dc0eac" exitCode=0 Oct 30 23:35:11.927869 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.927841 5112 generic.go:356] "Generic (PLEG): container finished" podID="81f1359870aca54abc3605a4dc88b335" containerID="a3eb80da9f885c402cb8a523c642d86488b49c8ce1436b096ab072bf22de1e8b" exitCode=0 Oct 30 23:35:11.940260 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.940243 5112 manager.go:324] Recovery completed Oct 30 23:35:11.959460 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.959411 5112 cpu_manager.go:226] "Starting" policy="none" Oct 30 23:35:11.959460 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.959425 5112 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 23:35:11.959460 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.959441 5112 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 23:35:11.959614 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.959549 5112 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 30 23:35:11.960004 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.959559 5112 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 30 23:35:11.960085 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.960005 5112 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 30 23:35:11.960085 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.960015 5112 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 30 23:35:11.960085 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.960023 5112 policy_none.go:50] "Start" Oct 30 23:35:11.960085 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.960034 5112 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 23:35:11.960085 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.960060 5112 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 23:35:11.960325 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.960211 5112 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 30 23:35:11.960325 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.960219 5112 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 30 23:35:11.960325 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.960224 5112 policy_none.go:44] "Start" Oct 30 23:35:11.964711 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.964687 5112 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 23:35:11.967314 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.967299 5112 manager.go:341] "Starting Device Plugin manager" Oct 30 23:35:11.967393 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:11.967327 5112 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 23:35:11.967393 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.967338 5112 server.go:87] "Starting device plugin registration server" Oct 30 23:35:11.967631 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.967618 5112 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 23:35:11.967699 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.967631 5112 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 23:35:11.968162 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.967738 5112 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 23:35:11.968162 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.967841 5112 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 23:35:11.968162 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.967868 5112 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 23:35:11.968162 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.967872 5112 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 23:35:11.968162 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.967904 5112 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T23:35:11.967860222Z","UUID":"4994195d-6eb9-4833-bd11-6fdf54917559","Handler":null,"Name":"","Endpoint":""} Oct 30 23:35:11.970207 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.968689 5112 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal"] Oct 30 23:35:11.970462 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.970441 5112 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 23:35:11.970541 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.970493 5112 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 23:35:11.970604 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:11.970568 5112 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 23:35:11.971455 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.971406 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" event={"ID":"115f903faf6fce7f69241f9f5ad98f46","Type":"ContainerStarted","Data":"0120c49f8bcab1eef5daa5793da57af3fc41e8d6f9fe0ae7f7d4cc7e6b2b1416"} Oct 30 23:35:11.971533 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.971464 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" event={"ID":"115f903faf6fce7f69241f9f5ad98f46","Type":"ContainerStarted","Data":"988486dce3f256714cfe3346a9788e386da2da5064aa8fe4d85ff7ab40642adb"} Oct 30 23:35:11.971533 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.971518 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" event={"ID":"81f1359870aca54abc3605a4dc88b335","Type":"ContainerStarted","Data":"542382d52031e4f6fa29670e106ef7bec56113ef3a8cc0705363cc5f8584b51e"} Oct 30 23:35:11.971661 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.971537 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" event={"ID":"81f1359870aca54abc3605a4dc88b335","Type":"ContainerDied","Data":"a3eb80da9f885c402cb8a523c642d86488b49c8ce1436b096ab072bf22de1e8b"} Oct 30 23:35:11.971661 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.971569 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" event={"ID":"81f1359870aca54abc3605a4dc88b335","Type":"ContainerStarted","Data":"58757b0008ba867b2086eadb26788481e45832055b279909d6619130d9134d76"} Oct 30 23:35:11.971858 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.971839 5112 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" Oct 30 23:35:11.972245 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.972166 5112 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:35:11.994278 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.994251 5112 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 23:35:11.994347 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:11.994285 5112 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 23:35:11.994347 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:11.994307 5112 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:35:11.994347 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:11.994327 5112 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-142.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" Oct 30 23:35:12.068253 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.068233 5112 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 23:35:12.069281 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.069266 5112 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientMemory" Oct 30 23:35:12.069359 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.069291 5112 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 23:35:12.069359 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.069300 5112 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-142.ec2.internal" event="NodeHasSufficientPID" Oct 30 23:35:12.069359 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.069343 5112 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-142.ec2.internal" Oct 30 23:35:12.074436 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.074420 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81f1359870aca54abc3605a4dc88b335-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal\" (UID: \"81f1359870aca54abc3605a4dc88b335\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:35:12.074501 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.074443 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f1359870aca54abc3605a4dc88b335-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal\" (UID: \"81f1359870aca54abc3605a4dc88b335\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:35:12.074501 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.074459 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/115f903faf6fce7f69241f9f5ad98f46-config\") pod \"kube-apiserver-proxy-ip-10-0-138-142.ec2.internal\" (UID: \"115f903faf6fce7f69241f9f5ad98f46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" Oct 30 23:35:12.102810 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.102791 5112 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-138-142.ec2.internal" Oct 30 23:35:12.102874 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.102834 5112 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-142.ec2.internal" Oct 30 23:35:12.174912 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.174886 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81f1359870aca54abc3605a4dc88b335-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal\" (UID: \"81f1359870aca54abc3605a4dc88b335\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:35:12.175000 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.174953 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f1359870aca54abc3605a4dc88b335-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal\" (UID: \"81f1359870aca54abc3605a4dc88b335\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:35:12.175000 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.174983 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/115f903faf6fce7f69241f9f5ad98f46-config\") pod \"kube-apiserver-proxy-ip-10-0-138-142.ec2.internal\" (UID: \"115f903faf6fce7f69241f9f5ad98f46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" Oct 30 23:35:12.175000 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.174957 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f1359870aca54abc3605a4dc88b335-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal\" (UID: \"81f1359870aca54abc3605a4dc88b335\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:35:12.175135 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.174958 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81f1359870aca54abc3605a4dc88b335-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal\" (UID: \"81f1359870aca54abc3605a4dc88b335\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal" Oct 30 23:35:12.175135 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.175059 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/115f903faf6fce7f69241f9f5ad98f46-config\") pod \"kube-apiserver-proxy-ip-10-0-138-142.ec2.internal\" (UID: \"115f903faf6fce7f69241f9f5ad98f46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" Oct 30 23:35:12.820469 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.820447 5112 apiserver.go:52] "Watching apiserver" Oct 30 23:35:12.881125 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.881105 5112 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 23:35:12.884556 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.882510 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-9tldd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-142.ec2.internal","openshift-multus/multus-wxzm8","openshift-multus/network-metrics-daemon-cf6r4","openshift-kube-storage-version-migrator/migrator-66df5d496b-6stc8","openshift-ingress/router-default-5b5577b589-v98nd","openshift-cluster-node-tuning-operator/tuned-lxbgd","openshift-kube-storage-version-migrator/migrator-66df5d496b-wtjbd","kube-system/konnectivity-agent-tmkjs","openshift-console-operator/console-operator-7cd56b8dbc-958pp","openshift-insights/insights-operator-7c4986d449-dwmwv","kube-system/kas-connection-checker-685895c7c9-mbbk5","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8","openshift-network-console/networking-console-plugin-86c478bb88-7mrn6","kube-system/kas-connection-checker-685895c7c9-m926q","kube-system/kas-connection-checker-685895c7c9-7z66c","openshift-image-registry/image-registry-865f789994-pzwps","kube-system/global-pull-secret-syncer-bqgch","openshift-ovn-kubernetes/ovnkube-node-8vljc","openshift-insights/insights-runtime-extractor-gkvsl","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns","openshift-insights/periodic-gathering-tb5lv-n7p5n","openshift-multus/multus-additional-cni-plugins-t2g7g","openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cht6c","openshift-image-registry/node-ca-xcbst","openshift-dns/dns-default-qpgjl","kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal","openshift-network-diagnostics/network-check-source-6f78d59f99-cgrj8","openshift-service-ca/service-ca-5fffc97bdf-hzzjp","openshift-ingress-canary/ingress-canary-m5ssb","openshift-dns/node-resolver-kh84m","openshift-network-diagnostics/network-check-target-2rjct","openshift-image-registry/image-registry-6749d98767-f4mjs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng","openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6"] Oct 30 23:35:12.885484 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.885466 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:12.885863 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.885847 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:12.886795 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.886777 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:12.888165 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.888149 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:12.888842 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.888829 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:12.889642 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.889628 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:35:12.894987 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.894971 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:12.896435 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.896417 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:12.898114 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.898098 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.898833 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.898813 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.899695 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.899675 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.899790 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.899686 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.899937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.899815 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Oct 30 23:35:12.900714 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.900693 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Oct 30 23:35:12.900800 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.900770 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:12.900800 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.900784 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.900907 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.900696 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.901084 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.901066 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Oct 30 23:35:12.901152 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.901121 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Oct 30 23:35:12.901213 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.901159 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.901213 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.901186 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.901382 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.901363 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Oct 30 23:35:12.901444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.901370 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Oct 30 23:35:12.901444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.901393 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-48l4h\"" Oct 30 23:35:12.901444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.901427 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Oct 30 23:35:12.901588 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.901548 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Oct 30 23:35:12.901588 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.901554 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9bbrw\"" Oct 30 23:35:12.901588 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.901560 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qhlbv\"" Oct 30 23:35:12.913683 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.913659 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 23:35:12.913783 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.913750 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.914262 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914243 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.914262 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914252 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Oct 30 23:35:12.914398 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914271 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 23:35:12.914398 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914299 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.914398 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914285 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Oct 30 23:35:12.914398 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914309 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.914398 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914387 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.914398 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914394 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 23:35:12.914701 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914407 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 23:35:12.914701 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914415 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.914701 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914443 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.914701 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914451 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.914701 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914476 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 23:35:12.914701 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914546 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.914891 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914769 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.914891 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914800 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.914891 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914818 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Oct 30 23:35:12.914891 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914836 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.914891 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.914861 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.915203 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915184 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 23:35:12.915203 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915196 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.915376 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915208 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.915376 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915247 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.915376 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915265 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 23:35:12.915376 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915301 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.915376 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915317 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 23:35:12.915376 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915328 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.915376 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915353 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 23:35:12.915376 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915361 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 23:35:12.915376 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915370 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915388 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915394 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915399 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915407 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915419 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915446 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v2jrp\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915409 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915465 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915447 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z4ngs\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915492 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915499 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915503 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915517 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915523 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915530 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915612 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915646 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 23:35:12.915704 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915702 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.916175 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.915747 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.922691 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.922676 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Oct 30 23:35:12.922691 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.922683 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Oct 30 23:35:12.922775 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.922705 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mgh6h\"" Oct 30 23:35:12.922775 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.922713 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xjgj5\"" Oct 30 23:35:12.925521 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925506 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8ljqd\"" Oct 30 23:35:12.925585 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925529 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-mp8rg\"" Oct 30 23:35:12.925585 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925571 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tzsrk\"" Oct 30 23:35:12.925585 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925577 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-jb9z2\"" Oct 30 23:35:12.925720 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925585 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 23:35:12.925720 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925598 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wrqrm\"" Oct 30 23:35:12.925720 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925617 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-p5ttc\"" Oct 30 23:35:12.925720 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925626 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jsrq7\"" Oct 30 23:35:12.925720 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925659 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-wj7js\"" Oct 30 23:35:12.925720 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925661 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l52wg\"" Oct 30 23:35:12.925720 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925678 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Oct 30 23:35:12.925720 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925696 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 23:35:12.926063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925732 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Oct 30 23:35:12.926063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925811 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 23:35:12.926063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925822 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vznwb\"" Oct 30 23:35:12.926063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925874 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dplzz\"" Oct 30 23:35:12.926063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925942 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-65zfb\"" Oct 30 23:35:12.926063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.925987 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 23:35:12.926063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.926020 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 23:35:12.926296 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.926077 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 23:35:12.926421 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.926384 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 30 23:35:12.926561 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.926490 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 23:35:12.926561 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.926503 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 23:35:12.926561 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.926508 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-5t726\"" Oct 30 23:35:12.926708 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.926648 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 23:35:12.926708 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.926653 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 23:35:12.926801 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.926765 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 30 23:35:12.926856 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.926841 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-rvj77\"" Oct 30 23:35:12.926941 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.926873 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Oct 30 23:35:12.926996 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.926951 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bj9t9\"" Oct 30 23:35:12.926996 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.926875 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 23:35:12.926996 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.926967 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vskkf\"" Oct 30 23:35:12.927125 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.927006 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-p2ccw\"" Oct 30 23:35:12.927125 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.927080 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2bmqg\"" Oct 30 23:35:12.927125 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.927120 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dqbbs\"" Oct 30 23:35:12.927346 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.927333 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-t8pc7\"" Oct 30 23:35:12.927447 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.927435 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-swxmn\"" Oct 30 23:35:12.938638 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.938617 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Oct 30 23:35:12.939881 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.939856 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 30 23:35:12.939949 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.939918 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 23:35:12.941836 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.941820 5112 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 23:35:12.981382 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981356 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-host\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.981478 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981389 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/580f7210-4806-4d98-95c0-a1b2613c1222-konnectivity-ca\") pod \"konnectivity-agent-tmkjs\" (UID: \"580f7210-4806-4d98-95c0-a1b2613c1222\") " pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:35:12.981478 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981405 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3549b0b4-488b-4819-b37a-8a566c3d5514-archives-path\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:12.981478 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981424 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-certificates\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:12.981622 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981545 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3549b0b4-488b-4819-b37a-8a566c3d5514-archives-path\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:12.981622 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981549 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-var-lib-kubelet\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.981622 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981611 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78sng\" (UniqueName: \"kubernetes.io/projected/938e07e9-87b4-4618-87c0-b59bd13e7282-kube-api-access-78sng\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:12.981768 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981641 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cb59a65-5d33-4842-abe0-582372433b12-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:12.981768 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981670 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-systemd\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.981768 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981694 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-system-cni-dir\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:12.981768 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981713 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-certificates\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:12.981768 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981718 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f5051b3-19d4-422e-a8d1-47129e287d57-ca-trust-extracted\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:12.981768 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981742 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-kubelet-config\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:35:12.982063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981779 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/580f7210-4806-4d98-95c0-a1b2613c1222-konnectivity-ca\") pod \"konnectivity-agent-tmkjs\" (UID: \"580f7210-4806-4d98-95c0-a1b2613c1222\") " pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:35:12.982063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981787 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:35:12.982063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981814 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkvqn\" (UniqueName: \"kubernetes.io/projected/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-kube-api-access-jkvqn\") pod \"service-ca-operator-544d749c8c-2ksc7\" (UID: \"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:12.982063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981819 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f5051b3-19d4-422e-a8d1-47129e287d57-ca-trust-extracted\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:12.982063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981838 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-cnibin\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.982063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981878 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-serving-cert\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:12.982063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981946 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-trusted-ca\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:12.982063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.981965 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cb59a65-5d33-4842-abe0-582372433b12-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:12.982063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982014 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-serving-cert\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:12.982063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982018 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj466\" (UniqueName: \"kubernetes.io/projected/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-kube-api-access-rj466\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:35:12.982469 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982140 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-kubelet\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.982469 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982149 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-original-pull-secret\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:35:12.982469 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982234 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-trusted-ca\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:12.982469 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982267 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-systemd\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.982469 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982307 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-netns\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.982469 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982345 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-daemon-config\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.982469 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982369 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-tmp\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.982469 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982421 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-tmp\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.982469 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982433 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27wgd\" (UniqueName: \"kubernetes.io/projected/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5-kube-api-access-27wgd\") pod \"ingress-canary-m5ssb\" (UID: \"55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5\") " pod="openshift-ingress-canary/ingress-canary-m5ssb" Oct 30 23:35:12.982469 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982450 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.982469 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982465 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-cni-bin\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.982780 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982480 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzhwj\" (UniqueName: \"kubernetes.io/projected/65fcac23-a536-479c-b515-28fbc7711990-kube-api-access-wzhwj\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:12.982780 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982494 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:12.982780 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982508 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:12.982780 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982549 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2wdw\" (UniqueName: \"kubernetes.io/projected/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-kube-api-access-h2wdw\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:12.982780 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982567 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-config\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:12.982780 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982581 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-daemon-config\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.982780 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982582 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cb59a65-5d33-4842-abe0-582372433b12-service-ca-bundle\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:12.982780 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982612 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-log-socket\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.982780 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982637 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-cni-multus\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.982780 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982683 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cb59a65-5d33-4842-abe0-582372433b12-service-ca-bundle\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:12.982780 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982715 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vc5z\" (UniqueName: \"kubernetes.io/projected/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-kube-api-access-5vc5z\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.982780 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982734 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/05a8da7c-7313-471b-8437-fff42cdbda65-ca-trust-extracted\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:12.983115 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982844 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-config\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:12.983115 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982849 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5j9g\" (UniqueName: \"kubernetes.io/projected/969fd947-a81d-4e6a-b369-550efce8f665-kube-api-access-b5j9g\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:35:12.983115 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982863 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/05a8da7c-7313-471b-8437-fff42cdbda65-ca-trust-extracted\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:12.983115 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982889 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s667\" (UniqueName: \"kubernetes.io/projected/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-kube-api-access-5s667\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:12.983115 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982917 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhfv\" (UniqueName: \"kubernetes.io/projected/fcf08154-6f21-453e-9028-7377db286d04-kube-api-access-plhfv\") pod \"network-check-source-6f78d59f99-cgrj8\" (UID: \"fcf08154-6f21-453e-9028-7377db286d04\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-cgrj8" Oct 30 23:35:12.983115 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.982939 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-modprobe-d\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.983115 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983055 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-7mrn6\" (UID: \"1302dd34-a67e-4861-96d8-1b98c2d2e314\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:12.983374 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983159 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-cnibin\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:12.983374 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983202 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-run\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.983374 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983245 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbtd2\" (UniqueName: \"kubernetes.io/projected/f2ba63b6-5f40-4d47-9b46-ec9f8888edce-kube-api-access-zbtd2\") pod \"volume-data-source-validator-58c9f5f46d-cht6c\" (UID: \"f2ba63b6-5f40-4d47-9b46-ec9f8888edce\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cht6c" Oct 30 23:35:12.983467 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983373 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb41b0b9-c085-4343-be37-07f224fc4f8e-crio-socket\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:12.983467 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983428 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:12.983467 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983456 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cb59a65-5d33-4842-abe0-582372433b12-tmp\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:12.983668 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983471 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:12.983668 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983492 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-service-ca-bundle\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:12.983668 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983528 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-system-cni-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.983668 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983598 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysctl-conf\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.983668 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983626 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cb59a65-5d33-4842-abe0-582372433b12-tmp\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:12.983668 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983646 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb9b4\" (UniqueName: \"kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4\") pod \"network-check-target-2rjct\" (UID: \"3e87ca45-ff16-44e3-a360-5252e624f610\") " pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:35:12.983937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983673 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-cni-binary-copy\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.983937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983682 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-service-ca-bundle\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:12.983937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983690 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:12.983937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983706 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-installation-pull-secrets\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:12.983937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983726 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rknsh\" (UniqueName: \"kubernetes.io/projected/ad6a30fe-07fa-48aa-92c3-4289c1066b37-kube-api-access-rknsh\") pod \"kas-connection-checker-685895c7c9-mbbk5\" (UID: \"ad6a30fe-07fa-48aa-92c3-4289c1066b37\") " pod="kube-system/kas-connection-checker-685895c7c9-mbbk5" Oct 30 23:35:12.983937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983758 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysctl-d\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.983937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983775 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7nv\" (UniqueName: \"kubernetes.io/projected/72875bb8-4630-4ff6-bda6-19710347ae74-kube-api-access-xz7nv\") pod \"kas-connection-checker-685895c7c9-m926q\" (UID: \"72875bb8-4630-4ff6-bda6-19710347ae74\") " pod="kube-system/kas-connection-checker-685895c7c9-m926q" Oct 30 23:35:12.983937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983793 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-registry-certificates\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:12.983937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983815 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-kubernetes\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.983937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983871 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-tuned\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.983937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983875 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-cni-binary-copy\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.983937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983908 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mfwz\" (UniqueName: \"kubernetes.io/projected/85f5885d-de4d-472f-aa8e-036454ea9a4d-kube-api-access-6mfwz\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-7plns\" (UID: \"85f5885d-de4d-472f-aa8e-036454ea9a4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:12.983937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983915 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-installation-pull-secrets\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:12.983937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983939 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:12.984471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.983952 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-tuned\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.984471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984066 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5d5343c7-fe93-4ee6-a987-d478c7801430-signing-cabundle\") pod \"service-ca-5fffc97bdf-hzzjp\" (UID: \"5d5343c7-fe93-4ee6-a987-d478c7801430\") " pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:12.984471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984095 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/931f746a-9d07-400d-9b4c-c16569e47a38-ovn-node-metrics-cert\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.984471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984092 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-registry-certificates\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:12.984471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984194 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-socket-dir-parent\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.984471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984212 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-sys\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.984471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984226 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-lib-modules\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.984471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984240 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-kubelet\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.984471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984255 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-k8s-cni-cncf-io\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.984471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984252 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5d5343c7-fe93-4ee6-a987-d478c7801430-signing-cabundle\") pod \"service-ca-5fffc97bdf-hzzjp\" (UID: \"5d5343c7-fe93-4ee6-a987-d478c7801430\") " pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:12.984471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984286 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-etc-kubernetes\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.984471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984314 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:12.984471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984346 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:12.984471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984416 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/931f746a-9d07-400d-9b4c-c16569e47a38-ovn-node-metrics-cert\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.984471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984441 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-tmp-dir\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:12.984902 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984503 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:12.984902 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984507 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-iptables-alerter-script\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:35:12.984902 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984510 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-tmp-dir\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:12.984902 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984544 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-serving-cert\") pod \"service-ca-operator-544d749c8c-2ksc7\" (UID: \"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:12.984902 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984620 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-bound-sa-token\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:12.984902 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984662 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:12.984902 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984692 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-hosts-file\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:35:12.984902 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984715 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-iptables-alerter-script\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:35:12.984902 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984718 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-serviceca\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:35:12.984902 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984763 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpvhk\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-kube-api-access-gpvhk\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:12.984902 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984794 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-trusted-ca\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:12.984902 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984813 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-serving-cert\") pod \"service-ca-operator-544d749c8c-2ksc7\" (UID: \"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:12.984902 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984889 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-serviceca\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984921 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-installation-pull-secrets\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984952 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-dbus\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984972 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.984986 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rvsv\" (UniqueName: \"kubernetes.io/projected/00f615e4-f815-49c8-b68d-23a95bc98a10-kube-api-access-8rvsv\") pod \"kas-connection-checker-685895c7c9-7z66c\" (UID: \"00f615e4-f815-49c8-b68d-23a95bc98a10\") " pod="kube-system/kas-connection-checker-685895c7c9-7z66c" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985059 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-trusted-ca\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985079 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-run-ovn-kubernetes\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985111 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ntz\" (UniqueName: \"kubernetes.io/projected/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-kube-api-access-c6ntz\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985136 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-registration-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985164 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985199 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-config-volume\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985207 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-installation-pull-secrets\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985230 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985247 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5-cert\") pod \"ingress-canary-m5ssb\" (UID: \"55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5\") " pod="openshift-ingress-canary/ingress-canary-m5ssb" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985272 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kx9g\" (UniqueName: \"kubernetes.io/projected/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-kube-api-access-7kx9g\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985312 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-config\") pod \"service-ca-operator-544d749c8c-2ksc7\" (UID: \"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985343 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-conf-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985371 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5d5343c7-fe93-4ee6-a987-d478c7801430-signing-key\") pod \"service-ca-5fffc97bdf-hzzjp\" (UID: \"5d5343c7-fe93-4ee6-a987-d478c7801430\") " pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985372 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-config-volume\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985405 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krsnz\" (UniqueName: \"kubernetes.io/projected/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-api-access-krsnz\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:12.985414 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985422 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9cb59a65-5d33-4842-abe0-582372433b12-snapshots\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985436 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbqzq\" (UniqueName: \"kubernetes.io/projected/ff7c1c2f-66d7-412e-b86c-a8502e575609-kube-api-access-tbqzq\") pod \"migrator-66df5d496b-wtjbd\" (UID: \"ff7c1c2f-66d7-412e-b86c-a8502e575609\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-wtjbd" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985457 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/580f7210-4806-4d98-95c0-a1b2613c1222-agent-certs\") pod \"konnectivity-agent-tmkjs\" (UID: \"580f7210-4806-4d98-95c0-a1b2613c1222\") " pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985473 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85f5885d-de4d-472f-aa8e-036454ea9a4d-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-7plns\" (UID: \"85f5885d-de4d-472f-aa8e-036454ea9a4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985456 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5-cert\") pod \"ingress-canary-m5ssb\" (UID: \"55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5\") " pod="openshift-ingress-canary/ingress-canary-m5ssb" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985493 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts5mb\" (UniqueName: \"kubernetes.io/projected/c5c08ca6-298f-4819-a28e-d4699cad5741-kube-api-access-ts5mb\") pod \"migrator-66df5d496b-6stc8\" (UID: \"c5c08ca6-298f-4819-a28e-d4699cad5741\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6stc8" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985513 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9cb59a65-5d33-4842-abe0-582372433b12-serving-cert\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985527 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-slash\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985549 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-env-overrides\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985565 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985579 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985595 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-node-log\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985528 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9cb59a65-5d33-4842-abe0-582372433b12-snapshots\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985635 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-image-registry-private-configuration\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985654 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5d5343c7-fe93-4ee6-a987-d478c7801430-signing-key\") pod \"service-ca-5fffc97bdf-hzzjp\" (UID: \"5d5343c7-fe93-4ee6-a987-d478c7801430\") " pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985665 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjs9k\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-kube-api-access-gjs9k\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985670 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85f5885d-de4d-472f-aa8e-036454ea9a4d-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-7plns\" (UID: \"85f5885d-de4d-472f-aa8e-036454ea9a4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985703 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/580f7210-4806-4d98-95c0-a1b2613c1222-agent-certs\") pod \"konnectivity-agent-tmkjs\" (UID: \"580f7210-4806-4d98-95c0-a1b2613c1222\") " pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985707 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4pbv\" (UniqueName: \"kubernetes.io/projected/9cb59a65-5d33-4842-abe0-582372433b12-kube-api-access-h4pbv\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985792 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-env-overrides\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985798 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-config\") pod \"service-ca-operator-544d749c8c-2ksc7\" (UID: \"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985857 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-host-slash\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985896 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-systemd-units\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985923 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985929 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-image-registry-private-configuration\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985949 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-cni-bin\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.985982 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-host\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986034 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-socket-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986073 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-sys-fs\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986101 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-bound-sa-token\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986109 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9cb59a65-5d33-4842-abe0-582372433b12-serving-cert\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986145 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff8p4\" (UniqueName: \"kubernetes.io/projected/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-kube-api-access-ff8p4\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986167 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:12.986180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986183 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-trusted-ca-bundle\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986208 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-hostroot\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986310 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986323 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysconfig\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986357 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986378 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-stats-auth\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986420 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtchh\" (UniqueName: \"kubernetes.io/projected/3549b0b4-488b-4819-b37a-8a566c3d5514-kube-api-access-vtchh\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986454 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-default-certificate\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986482 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-run-netns\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986487 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-trusted-ca-bundle\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986507 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-var-lib-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986559 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-stats-auth\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986564 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8b2p\" (UniqueName: \"kubernetes.io/projected/931f746a-9d07-400d-9b4c-c16569e47a38-kube-api-access-n8b2p\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986590 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-image-registry-private-configuration\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986688 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-default-certificate\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986699 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkbtl\" (UniqueName: \"kubernetes.io/projected/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-kube-api-access-fkbtl\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986727 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb41b0b9-c085-4343-be37-07f224fc4f8e-data-volume\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986766 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-cni-netd\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986783 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-tmp-dir\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986797 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-etc-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986817 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-ovn\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986823 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb41b0b9-c085-4343-be37-07f224fc4f8e-data-volume\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986839 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986864 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-image-registry-private-configuration\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986871 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-tmp-dir\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986879 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zdn2\" (UniqueName: \"kubernetes.io/projected/5d5343c7-fe93-4ee6-a987-d478c7801430-kube-api-access-8zdn2\") pod \"service-ca-5fffc97bdf-hzzjp\" (UID: \"5d5343c7-fe93-4ee6-a987-d478c7801430\") " pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986909 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.986942 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6trgt\" (UniqueName: \"kubernetes.io/projected/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-kube-api-access-6trgt\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987010 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-device-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987028 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1302dd34-a67e-4861-96d8-1b98c2d2e314-nginx-conf\") pod \"networking-console-plugin-86c478bb88-7mrn6\" (UID: \"1302dd34-a67e-4861-96d8-1b98c2d2e314\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987058 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85f5885d-de4d-472f-aa8e-036454ea9a4d-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-7plns\" (UID: \"85f5885d-de4d-472f-aa8e-036454ea9a4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:12.987101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987092 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/938e07e9-87b4-4618-87c0-b59bd13e7282-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:12.988060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987166 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-ovnkube-script-lib\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.988060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987198 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-cni-binary-copy\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:12.988060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987224 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-trusted-ca\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:12.988060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987246 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85f5885d-de4d-472f-aa8e-036454ea9a4d-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-7plns\" (UID: \"85f5885d-de4d-472f-aa8e-036454ea9a4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:12.988060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987250 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-ovnkube-config\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.988060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987269 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1302dd34-a67e-4861-96d8-1b98c2d2e314-nginx-conf\") pod \"networking-console-plugin-86c478bb88-7mrn6\" (UID: \"1302dd34-a67e-4861-96d8-1b98c2d2e314\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:12.988060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987291 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-cni-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.988060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987305 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/938e07e9-87b4-4618-87c0-b59bd13e7282-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:12.988060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987324 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-multus-certs\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:12.988060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987364 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbpdj\" (UniqueName: \"kubernetes.io/projected/4c7342b5-72f1-461d-8a00-eff0e377a4fe-kube-api-access-fbpdj\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:12.988060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987375 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65fcac23-a536-479c-b515-28fbc7711990-cni-binary-copy\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:12.988060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987417 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-ovnkube-config\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.988060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987442 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/931f746a-9d07-400d-9b4c-c16569e47a38-ovnkube-script-lib\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:12.988060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:12.987527 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-trusted-ca\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:13.002590 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.002534 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkvqn\" (UniqueName: \"kubernetes.io/projected/ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6-kube-api-access-jkvqn\") pod \"service-ca-operator-544d749c8c-2ksc7\" (UID: \"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" Oct 30 23:35:13.002705 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.002616 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vc5z\" (UniqueName: \"kubernetes.io/projected/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-kube-api-access-5vc5z\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.002705 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.002702 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj466\" (UniqueName: \"kubernetes.io/projected/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-kube-api-access-rj466\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:35:13.002860 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.002808 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plhfv\" (UniqueName: \"kubernetes.io/projected/fcf08154-6f21-453e-9028-7377db286d04-kube-api-access-plhfv\") pod \"network-check-source-6f78d59f99-cgrj8\" (UID: \"fcf08154-6f21-453e-9028-7377db286d04\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-cgrj8" Oct 30 23:35:13.002860 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.002816 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27wgd\" (UniqueName: \"kubernetes.io/projected/55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5-kube-api-access-27wgd\") pod \"ingress-canary-m5ssb\" (UID: \"55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5\") " pod="openshift-ingress-canary/ingress-canary-m5ssb" Oct 30 23:35:13.003004 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.002934 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s667\" (UniqueName: \"kubernetes.io/projected/707fcc17-c66a-458e-bcb5-8b3558dbe8c4-kube-api-access-5s667\") pod \"console-operator-7cd56b8dbc-958pp\" (UID: \"707fcc17-c66a-458e-bcb5-8b3558dbe8c4\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:13.003004 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.002958 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbtd2\" (UniqueName: \"kubernetes.io/projected/f2ba63b6-5f40-4d47-9b46-ec9f8888edce-kube-api-access-zbtd2\") pod \"volume-data-source-validator-58c9f5f46d-cht6c\" (UID: \"f2ba63b6-5f40-4d47-9b46-ec9f8888edce\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cht6c" Oct 30 23:35:13.003242 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.003093 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mfwz\" (UniqueName: \"kubernetes.io/projected/85f5885d-de4d-472f-aa8e-036454ea9a4d-kube-api-access-6mfwz\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-7plns\" (UID: \"85f5885d-de4d-472f-aa8e-036454ea9a4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" Oct 30 23:35:13.003242 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.003164 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2wdw\" (UniqueName: \"kubernetes.io/projected/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-kube-api-access-h2wdw\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:13.003242 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.003230 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz7nv\" (UniqueName: \"kubernetes.io/projected/72875bb8-4630-4ff6-bda6-19710347ae74-kube-api-access-xz7nv\") pod \"kas-connection-checker-685895c7c9-m926q\" (UID: \"72875bb8-4630-4ff6-bda6-19710347ae74\") " pod="kube-system/kas-connection-checker-685895c7c9-m926q" Oct 30 23:35:13.003379 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.003359 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5j9g\" (UniqueName: \"kubernetes.io/projected/969fd947-a81d-4e6a-b369-550efce8f665-kube-api-access-b5j9g\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:35:13.003445 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.003430 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzhwj\" (UniqueName: \"kubernetes.io/projected/65fcac23-a536-479c-b515-28fbc7711990-kube-api-access-wzhwj\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:13.003548 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.003530 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rknsh\" (UniqueName: \"kubernetes.io/projected/ad6a30fe-07fa-48aa-92c3-4289c1066b37-kube-api-access-rknsh\") pod \"kas-connection-checker-685895c7c9-mbbk5\" (UID: \"ad6a30fe-07fa-48aa-92c3-4289c1066b37\") " pod="kube-system/kas-connection-checker-685895c7c9-mbbk5" Oct 30 23:35:13.003655 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.003636 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb9b4\" (UniqueName: \"kubernetes.io/projected/3e87ca45-ff16-44e3-a360-5252e624f610-kube-api-access-xb9b4\") pod \"network-check-target-2rjct\" (UID: \"3e87ca45-ff16-44e3-a360-5252e624f610\") " pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:35:13.003741 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.003727 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78sng\" (UniqueName: \"kubernetes.io/projected/938e07e9-87b4-4618-87c0-b59bd13e7282-kube-api-access-78sng\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:13.006933 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.006917 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbqzq\" (UniqueName: \"kubernetes.io/projected/ff7c1c2f-66d7-412e-b86c-a8502e575609-kube-api-access-tbqzq\") pod \"migrator-66df5d496b-wtjbd\" (UID: \"ff7c1c2f-66d7-412e-b86c-a8502e575609\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-wtjbd" Oct 30 23:35:13.007186 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.007163 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krsnz\" (UniqueName: \"kubernetes.io/projected/fb41b0b9-c085-4343-be37-07f224fc4f8e-kube-api-access-krsnz\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:13.007425 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.007410 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4pbv\" (UniqueName: \"kubernetes.io/projected/9cb59a65-5d33-4842-abe0-582372433b12-kube-api-access-h4pbv\") pod \"insights-operator-7c4986d449-dwmwv\" (UID: \"9cb59a65-5d33-4842-abe0-582372433b12\") " pod="openshift-insights/insights-operator-7c4986d449-dwmwv" Oct 30 23:35:13.007478 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.007460 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-bound-sa-token\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:13.008359 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.007822 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts5mb\" (UniqueName: \"kubernetes.io/projected/c5c08ca6-298f-4819-a28e-d4699cad5741-kube-api-access-ts5mb\") pod \"migrator-66df5d496b-6stc8\" (UID: \"c5c08ca6-298f-4819-a28e-d4699cad5741\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-6stc8" Oct 30 23:35:13.008359 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.007837 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6ntz\" (UniqueName: \"kubernetes.io/projected/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-kube-api-access-c6ntz\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:35:13.008359 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.007915 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjs9k\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-kube-api-access-gjs9k\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:13.008359 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.008282 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rvsv\" (UniqueName: \"kubernetes.io/projected/00f615e4-f815-49c8-b68d-23a95bc98a10-kube-api-access-8rvsv\") pod \"kas-connection-checker-685895c7c9-7z66c\" (UID: \"00f615e4-f815-49c8-b68d-23a95bc98a10\") " pod="kube-system/kas-connection-checker-685895c7c9-7z66c" Oct 30 23:35:13.008359 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.008320 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8b2p\" (UniqueName: \"kubernetes.io/projected/931f746a-9d07-400d-9b4c-c16569e47a38-kube-api-access-n8b2p\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.008359 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.008347 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-bound-sa-token\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:13.008701 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.008348 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kx9g\" (UniqueName: \"kubernetes.io/projected/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-kube-api-access-7kx9g\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:35:13.008701 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.008465 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbpdj\" (UniqueName: \"kubernetes.io/projected/4c7342b5-72f1-461d-8a00-eff0e377a4fe-kube-api-access-fbpdj\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:13.008701 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.008520 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkbtl\" (UniqueName: \"kubernetes.io/projected/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-kube-api-access-fkbtl\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:13.008701 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.008607 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zdn2\" (UniqueName: \"kubernetes.io/projected/5d5343c7-fe93-4ee6-a987-d478c7801430-kube-api-access-8zdn2\") pod \"service-ca-5fffc97bdf-hzzjp\" (UID: \"5d5343c7-fe93-4ee6-a987-d478c7801430\") " pod="openshift-service-ca/service-ca-5fffc97bdf-hzzjp" Oct 30 23:35:13.009097 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.009078 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6trgt\" (UniqueName: \"kubernetes.io/projected/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-kube-api-access-6trgt\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:13.009152 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.009101 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpvhk\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-kube-api-access-gpvhk\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:13.009152 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.009084 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtchh\" (UniqueName: \"kubernetes.io/projected/3549b0b4-488b-4819-b37a-8a566c3d5514-kube-api-access-vtchh\") pod \"periodic-gathering-tb5lv-n7p5n\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:35:13.009152 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.009124 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff8p4\" (UniqueName: \"kubernetes.io/projected/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-kube-api-access-ff8p4\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.087734 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087687 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-lib-modules\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.087734 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087709 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-kubelet\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.087734 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087724 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-k8s-cni-cncf-io\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087737 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-etc-kubernetes\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087752 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087766 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-hosts-file\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087803 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-dbus\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087811 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-k8s-cni-cncf-io\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087835 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-run-ovn-kubernetes\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087854 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-registration-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087864 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-lib-modules\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087804 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-kubelet\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087851 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087869 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-run-ovn-kubernetes\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087893 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-registration-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087907 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc6ae729-bb57-4d5f-9112-69dc5d0abee9-hosts-file\") pod \"node-resolver-kh84m\" (UID: \"fc6ae729-bb57-4d5f-9112-69dc5d0abee9\") " pod="openshift-dns/node-resolver-kh84m" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087872 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-dbus\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087870 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:13.087927 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.087933 5112 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087835 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-etc-kubernetes\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087949 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087977 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-conf-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.087999 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-slash\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088001 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-conf-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.087947 5112 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6749d98767-f4mjs: secret "image-registry-tls" not found Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.088017 5112 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088023 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.088030 5112 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865f789994-pzwps: secret "image-registry-tls" not found Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088058 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-slash\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088062 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-node-log\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.088089 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls podName:2f5051b3-19d4-422e-a8d1-47129e287d57 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:13.588071401 +0000 UTC m=+1.851976952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls") pod "image-registry-6749d98767-f4mjs" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57") : secret "image-registry-tls" not found Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088096 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088099 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-node-log\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.088125 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls podName:05a8da7c-7313-471b-8437-fff42cdbda65 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:13.588113314 +0000 UTC m=+1.852018868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls") pod "image-registry-865f789994-pzwps" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65") : secret "image-registry-tls" not found Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088154 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-host-slash\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088170 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-systemd-units\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088184 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-cni-bin\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088193 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae-host-slash\") pod \"iptables-alerter-9tldd\" (UID: \"e260fd6e-f3d5-4a32-a6e4-afa7389ec4ae\") " pod="openshift-network-operator/iptables-alerter-9tldd" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088197 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-host\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088222 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9448c7a-5b0e-4ff7-808b-889a0d8b022f-host\") pod \"node-ca-xcbst\" (UID: \"c9448c7a-5b0e-4ff7-808b-889a0d8b022f\") " pod="openshift-image-registry/node-ca-xcbst" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088234 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-socket-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088243 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-systemd-units\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088260 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-sys-fs\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088284 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-socket-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088290 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-hostroot\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088303 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-sys-fs\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088314 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysconfig\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088339 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysconfig\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088338 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088253 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-cni-bin\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088316 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-hostroot\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088363 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-run-netns\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088394 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-var-lib-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088398 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-run-netns\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088411 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-cni-netd\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088438 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-cni-netd\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088443 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-var-lib-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088456 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-etc-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088471 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-ovn\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088482 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-etc-openvswitch\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088485 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088516 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.088534 5112 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088539 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-device-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088546 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-ovn\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088566 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-cni-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.088586 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs podName:969fd947-a81d-4e6a-b369-550efce8f665 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:13.588572863 +0000 UTC m=+1.852478434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs") pod "network-metrics-daemon-cf6r4" (UID: "969fd947-a81d-4e6a-b369-550efce8f665") : secret "metrics-daemon-secret" not found Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088598 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-device-dir\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088610 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-multus-certs\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088620 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-cni-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088635 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-host\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088646 5112 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088658 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-multus-certs\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088660 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-var-lib-kubelet\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088692 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-systemd\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088705 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-var-lib-kubelet\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088712 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-host\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.088676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088713 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-system-cni-dir\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088741 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-system-cni-dir\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088749 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-run-systemd\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088745 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-kubelet-config\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088780 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91-kubelet-config\") pod \"global-pull-secret-syncer-bqgch\" (UID: \"4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91\") " pod="kube-system/global-pull-secret-syncer-bqgch" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088786 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-cnibin\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088812 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-cnibin\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088814 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-kubelet\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088839 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-systemd\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088859 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-kubelet\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088862 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-netns\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088891 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088897 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-run-netns\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088906 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-cni-bin\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088933 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088946 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-systemd\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088956 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088981 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-log-socket\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088985 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-cni-bin\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.088954 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089003 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-cni-multus\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089030 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/931f746a-9d07-400d-9b4c-c16569e47a38-log-socket\") pod \"ovnkube-node-8vljc\" (UID: \"931f746a-9d07-400d-9b4c-c16569e47a38\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089051 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-modprobe-d\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.089077 5112 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.089122 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls podName:b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d nodeName:}" failed. No retries permitted until 2026-10-30 23:35:13.589108932 +0000 UTC m=+1.853014485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls") pod "dns-default-qpgjl" (UID: "b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d") : secret "dns-default-metrics-tls" not found Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089000 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c7342b5-72f1-461d-8a00-eff0e377a4fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-75fng\" (UID: \"4c7342b5-72f1-461d-8a00-eff0e377a4fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-75fng" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089053 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-host-var-lib-cni-multus\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089078 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-7mrn6\" (UID: \"1302dd34-a67e-4861-96d8-1b98c2d2e314\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089136 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-modprobe-d\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089165 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-cnibin\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089190 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-run\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089200 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-cnibin\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089168 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-service-ca-bundle\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089246 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb41b0b9-c085-4343-be37-07f224fc4f8e-crio-socket\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089271 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-run\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089271 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089304 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089313 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb41b0b9-c085-4343-be37-07f224fc4f8e-crio-socket\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.089346 5112 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.089361 5112 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089344 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-system-cni-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089388 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-system-cni-dir\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.089379 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls podName:fb41b0b9-c085-4343-be37-07f224fc4f8e nodeName:}" failed. No retries permitted until 2026-10-30 23:35:13.589367389 +0000 UTC m=+1.853272938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkvsl" (UID: "fb41b0b9-c085-4343-be37-07f224fc4f8e") : secret "insights-runtime-extractor-tls" not found Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.089437 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs podName:f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:13.589422159 +0000 UTC m=+1.853327719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs") pod "router-default-5b5577b589-v98nd" (UID: "f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4") : secret "router-metrics-certs-default" not found Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089463 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysctl-conf\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089489 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089515 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysctl-d\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089539 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-kubernetes\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089564 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089584 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65fcac23-a536-479c-b515-28fbc7711990-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t2g7g\" (UID: \"65fcac23-a536-479c-b515-28fbc7711990\") " pod="openshift-multus/multus-additional-cni-plugins-t2g7g" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089594 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-kubernetes\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089631 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysctl-conf\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089591 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-socket-dir-parent\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089647 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-etc-sysctl-d\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089634 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed39bbb9-fa16-45b9-98e4-84c920c6a5df-multus-socket-dir-parent\") pod \"multus-wxzm8\" (UID: \"ed39bbb9-fa16-45b9-98e4-84c920c6a5df\") " pod="openshift-multus/multus-wxzm8" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089671 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-sys\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.090763 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.089708 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b2eb3ea-17b1-4cec-ab47-27be6876bf69-sys\") pod \"tuned-lxbgd\" (UID: \"8b2eb3ea-17b1-4cec-ab47-27be6876bf69\") " pod="openshift-cluster-node-tuning-operator/tuned-lxbgd" Oct 30 23:35:13.092484 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.090858 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/938e07e9-87b4-4618-87c0-b59bd13e7282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sc2z6\" (UID: \"938e07e9-87b4-4618-87c0-b59bd13e7282\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:13.092484 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.091259 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1302dd34-a67e-4861-96d8-1b98c2d2e314-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-7mrn6\" (UID: \"1302dd34-a67e-4861-96d8-1b98c2d2e314\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:13.092484 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.092086 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a89e6ed3-bb09-4d7f-85cb-092cd129b7bb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-87pc8\" (UID: \"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:13.186116 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.186094 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" Oct 30 23:35:13.187879 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.187861 5112 scope.go:122] "RemoveContainer" containerID="3ea4b50601647a9ba5327b72953a23ad0585b88fc5790b48a10ea397a9a5779a" Oct 30 23:35:13.188376 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.188355 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" Oct 30 23:35:13.189052 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.189022 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" Oct 30 23:35:13.502397 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.502369 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8"] Oct 30 23:35:13.508961 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.508937 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-7mrn6"] Oct 30 23:35:13.517388 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.517367 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6"] Oct 30 23:35:13.522193 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:13.522168 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1302dd34_a67e_4861_96d8_1b98c2d2e314.slice/crio-25c2b99ef46ae29ff714601d730fb025914172cb6014a3c588dbc45f6317901b WatchSource:0}: Error finding container 25c2b99ef46ae29ff714601d730fb025914172cb6014a3c588dbc45f6317901b: Status 404 returned error can't find the container with id 25c2b99ef46ae29ff714601d730fb025914172cb6014a3c588dbc45f6317901b Oct 30 23:35:13.523152 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:13.523128 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod938e07e9_87b4_4618_87c0_b59bd13e7282.slice/crio-879c43d1441955a6e97eeaf23a534e9222e23b945856b6972ab51908c855714b WatchSource:0}: Error finding container 879c43d1441955a6e97eeaf23a534e9222e23b945856b6972ab51908c855714b: Status 404 returned error can't find the container with id 879c43d1441955a6e97eeaf23a534e9222e23b945856b6972ab51908c855714b Oct 30 23:35:13.524474 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.524458 5112 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 23:35:13.593452 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.593429 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:35:13.593530 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.593470 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:13.593530 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.593493 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:13.593530 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.593509 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:13.593684 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.593540 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:13.593684 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.593558 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:13.593684 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.593579 5112 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 23:35:13.593684 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.593637 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls podName:b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d nodeName:}" failed. No retries permitted until 2026-10-30 23:35:14.593619382 +0000 UTC m=+2.857524962 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls") pod "dns-default-qpgjl" (UID: "b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d") : secret "dns-default-metrics-tls" not found Oct 30 23:35:13.593684 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.593637 5112 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 23:35:13.593684 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.593660 5112 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 23:35:13.593684 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.593678 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls podName:fb41b0b9-c085-4343-be37-07f224fc4f8e nodeName:}" failed. No retries permitted until 2026-10-30 23:35:14.593666769 +0000 UTC m=+2.857572333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkvsl" (UID: "fb41b0b9-c085-4343-be37-07f224fc4f8e") : secret "insights-runtime-extractor-tls" not found Oct 30 23:35:13.593684 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.593676 5112 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:13.593970 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.593697 5112 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6749d98767-f4mjs: secret "image-registry-tls" not found Oct 30 23:35:13.593970 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.593714 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs podName:f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:14.593699325 +0000 UTC m=+2.857604887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs") pod "router-default-5b5577b589-v98nd" (UID: "f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4") : secret "router-metrics-certs-default" not found Oct 30 23:35:13.593970 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.593579 5112 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 23:35:13.593970 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.593665 5112 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:13.593970 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.593745 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls podName:2f5051b3-19d4-422e-a8d1-47129e287d57 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:14.593729033 +0000 UTC m=+2.857634587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls") pod "image-registry-6749d98767-f4mjs" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57") : secret "image-registry-tls" not found Oct 30 23:35:13.593970 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.593757 5112 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865f789994-pzwps: secret "image-registry-tls" not found Oct 30 23:35:13.593970 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.593764 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs podName:969fd947-a81d-4e6a-b369-550efce8f665 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:14.593754214 +0000 UTC m=+2.857659768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs") pod "network-metrics-daemon-cf6r4" (UID: "969fd947-a81d-4e6a-b369-550efce8f665") : secret "metrics-daemon-secret" not found Oct 30 23:35:13.593970 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.593799 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls podName:05a8da7c-7313-471b-8437-fff42cdbda65 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:14.5937869 +0000 UTC m=+2.857692470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls") pod "image-registry-865f789994-pzwps" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65") : secret "image-registry-tls" not found Oct 30 23:35:13.929380 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.929355 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:13.945034 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.945009 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" event={"ID":"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb","Type":"ContainerStarted","Data":"a2112cb17b8ececbd2a7fc0996275e76d868568cd55e7f18fdf8dc17585c90c7"} Oct 30 23:35:13.946152 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.946128 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" event={"ID":"938e07e9-87b4-4618-87c0-b59bd13e7282","Type":"ContainerStarted","Data":"879c43d1441955a6e97eeaf23a534e9222e23b945856b6972ab51908c855714b"} Oct 30 23:35:13.947488 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.947471 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/2.log" Oct 30 23:35:13.947862 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.947845 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/1.log" Oct 30 23:35:13.947906 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.947879 5112 generic.go:356] "Generic (PLEG): container finished" podID="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" containerID="9ec4e5b4f1696f28959221def8da02146a7e79ad3f307abb43ea50c3c1d701b6" exitCode=255 Oct 30 23:35:13.947967 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.947952 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" event={"ID":"707fcc17-c66a-458e-bcb5-8b3558dbe8c4","Type":"ContainerDied","Data":"9ec4e5b4f1696f28959221def8da02146a7e79ad3f307abb43ea50c3c1d701b6"} Oct 30 23:35:13.948004 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.947993 5112 scope.go:122] "RemoveContainer" containerID="3ea4b50601647a9ba5327b72953a23ad0585b88fc5790b48a10ea397a9a5779a" Oct 30 23:35:13.948370 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.948351 5112 scope.go:122] "RemoveContainer" containerID="9ec4e5b4f1696f28959221def8da02146a7e79ad3f307abb43ea50c3c1d701b6" Oct 30 23:35:13.948573 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:13.948539 5112 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-958pp_openshift-console-operator(707fcc17-c66a-458e-bcb5-8b3558dbe8c4)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" podUID="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" Oct 30 23:35:13.949183 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:13.949165 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" event={"ID":"1302dd34-a67e-4861-96d8-1b98c2d2e314","Type":"ContainerStarted","Data":"25c2b99ef46ae29ff714601d730fb025914172cb6014a3c588dbc45f6317901b"} Oct 30 23:35:14.370072 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:14.369936 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:14.602827 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:14.602786 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:14.602967 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:14.602835 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:14.602967 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:14.602896 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:35:14.602967 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:14.602949 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:14.603072 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:14.602986 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:14.603072 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:14.603026 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:14.603191 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:14.603167 5112 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 23:35:14.603242 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:14.603233 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs podName:f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:16.603217129 +0000 UTC m=+4.867122681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs") pod "router-default-5b5577b589-v98nd" (UID: "f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4") : secret "router-metrics-certs-default" not found Oct 30 23:35:14.603647 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:14.603628 5112 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:14.603731 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:14.603648 5112 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6749d98767-f4mjs: secret "image-registry-tls" not found Oct 30 23:35:14.603731 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:14.603705 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls podName:2f5051b3-19d4-422e-a8d1-47129e287d57 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:16.603689781 +0000 UTC m=+4.867595334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls") pod "image-registry-6749d98767-f4mjs" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57") : secret "image-registry-tls" not found Oct 30 23:35:14.603847 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:14.603766 5112 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:14.603847 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:14.603790 5112 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865f789994-pzwps: secret "image-registry-tls" not found Oct 30 23:35:14.603847 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:14.603824 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls podName:05a8da7c-7313-471b-8437-fff42cdbda65 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:16.603811717 +0000 UTC m=+4.867717281 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls") pod "image-registry-865f789994-pzwps" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65") : secret "image-registry-tls" not found Oct 30 23:35:14.603993 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:14.603883 5112 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 23:35:14.603993 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:14.603911 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs podName:969fd947-a81d-4e6a-b369-550efce8f665 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:16.603902113 +0000 UTC m=+4.867807677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs") pod "network-metrics-daemon-cf6r4" (UID: "969fd947-a81d-4e6a-b369-550efce8f665") : secret "metrics-daemon-secret" not found Oct 30 23:35:14.604397 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:14.604378 5112 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 23:35:14.604468 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:14.604435 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls podName:fb41b0b9-c085-4343-be37-07f224fc4f8e nodeName:}" failed. No retries permitted until 2026-10-30 23:35:16.604419714 +0000 UTC m=+4.868325267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkvsl" (UID: "fb41b0b9-c085-4343-be37-07f224fc4f8e") : secret "insights-runtime-extractor-tls" not found Oct 30 23:35:14.606936 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:14.606891 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d-metrics-tls\") pod \"dns-default-qpgjl\" (UID: \"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d\") " pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:14.697440 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:14.697371 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:14.956376 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:14.956295 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/2.log" Oct 30 23:35:14.959074 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:14.958621 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-7mrn6" event={"ID":"1302dd34-a67e-4861-96d8-1b98c2d2e314","Type":"ContainerStarted","Data":"5e008c5e28c91605756bd592cae650e2f44916cc9ecaf319fb7f92742bc2b422"} Oct 30 23:35:14.959074 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:14.958671 5112 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 23:35:15.012267 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:15.012238 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qpgjl"] Oct 30 23:35:15.965122 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:15.965028 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qpgjl" event={"ID":"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d","Type":"ContainerStarted","Data":"153a3a8616b027655119f0f1bd05089cd1a20ae4b9f767ccf439af5e59aa547a"} Oct 30 23:35:15.967275 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:15.967227 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" event={"ID":"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb","Type":"ContainerStarted","Data":"283a56d3d5df7cd0f7996fd89d06ddf1423959567f3eaf35ac850ba24fbfd10e"} Oct 30 23:35:15.967471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:15.967302 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-87pc8" event={"ID":"a89e6ed3-bb09-4d7f-85cb-092cd129b7bb","Type":"ContainerStarted","Data":"087fd525b2d418942802bc5a2549885ad284177acaef5a2593497ad316339ed2"} Oct 30 23:35:15.969417 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:15.969392 5112 generic.go:356] "Generic (PLEG): container finished" podID="9cb59a65-5d33-4842-abe0-582372433b12" containerID="7474a42d2f1e0565ef843f9465a74f4881106fa1216f64157b897f089966c3cf" exitCode=0 Oct 30 23:35:15.969508 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:15.969482 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-dwmwv" event={"ID":"9cb59a65-5d33-4842-abe0-582372433b12","Type":"ContainerDied","Data":"7474a42d2f1e0565ef843f9465a74f4881106fa1216f64157b897f089966c3cf"} Oct 30 23:35:15.969829 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:15.969814 5112 scope.go:122] "RemoveContainer" containerID="7474a42d2f1e0565ef843f9465a74f4881106fa1216f64157b897f089966c3cf" Oct 30 23:35:15.971855 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:15.971832 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sc2z6" event={"ID":"938e07e9-87b4-4618-87c0-b59bd13e7282","Type":"ContainerStarted","Data":"ec76f28ba9c983d8814900f83cfc5b123be840ed75f680773529e6800923008e"} Oct 30 23:35:16.621635 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:16.621580 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:16.621635 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:16.621637 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:16.621854 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:16.621694 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:16.621854 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:16.621723 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:16.621854 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:16.621772 5112 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 23:35:16.621854 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:16.621815 5112 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 23:35:16.621854 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:16.621821 5112 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:16.621854 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:16.621839 5112 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 23:35:16.621854 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:16.621843 5112 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6749d98767-f4mjs: secret "image-registry-tls" not found Oct 30 23:35:16.621854 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:16.621850 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls podName:fb41b0b9-c085-4343-be37-07f224fc4f8e nodeName:}" failed. No retries permitted until 2026-10-30 23:35:20.62182886 +0000 UTC m=+8.885734415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkvsl" (UID: "fb41b0b9-c085-4343-be37-07f224fc4f8e") : secret "insights-runtime-extractor-tls" not found Oct 30 23:35:16.622181 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:16.621779 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:35:16.622181 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:16.621874 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs podName:f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:20.621857525 +0000 UTC m=+8.885763093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs") pod "router-default-5b5577b589-v98nd" (UID: "f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4") : secret "router-metrics-certs-default" not found Oct 30 23:35:16.622181 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:16.621889 5112 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 23:35:16.622181 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:16.621904 5112 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865f789994-pzwps: secret "image-registry-tls" not found Oct 30 23:35:16.622181 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:16.621893 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs podName:969fd947-a81d-4e6a-b369-550efce8f665 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:20.621885693 +0000 UTC m=+8.885791253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs") pod "network-metrics-daemon-cf6r4" (UID: "969fd947-a81d-4e6a-b369-550efce8f665") : secret "metrics-daemon-secret" not found Oct 30 23:35:16.622181 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:16.621958 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls podName:2f5051b3-19d4-422e-a8d1-47129e287d57 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:20.621945539 +0000 UTC m=+8.885851093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls") pod "image-registry-6749d98767-f4mjs" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57") : secret "image-registry-tls" not found Oct 30 23:35:16.622181 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:16.621982 5112 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls podName:05a8da7c-7313-471b-8437-fff42cdbda65 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:20.621972712 +0000 UTC m=+8.885878265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls") pod "image-registry-865f789994-pzwps" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65") : secret "image-registry-tls" not found Oct 30 23:35:16.976692 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:16.976663 5112 generic.go:356] "Generic (PLEG): container finished" podID="ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6" containerID="51ca39f33e4168b4230fcc85d36acf8a20666014e6729cec88fad96bf9e070b9" exitCode=0 Oct 30 23:35:16.977082 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:16.976737 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" event={"ID":"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6","Type":"ContainerDied","Data":"51ca39f33e4168b4230fcc85d36acf8a20666014e6729cec88fad96bf9e070b9"} Oct 30 23:35:16.977138 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:16.977119 5112 scope.go:122] "RemoveContainer" containerID="51ca39f33e4168b4230fcc85d36acf8a20666014e6729cec88fad96bf9e070b9" Oct 30 23:35:16.978799 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:16.978777 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qpgjl" event={"ID":"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d","Type":"ContainerStarted","Data":"730cd71af796c78213a7ea80f577ed25a2ace7c8ea51fab204b660d5e1b81bce"} Oct 30 23:35:16.978913 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:16.978822 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qpgjl" event={"ID":"b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d","Type":"ContainerStarted","Data":"95b925729f8259d1038ccfb5cf7edb583c570397abc83d27114dfb00f6cc5f91"} Oct 30 23:35:16.978913 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:16.978867 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:16.980716 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:16.980689 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-dwmwv" event={"ID":"9cb59a65-5d33-4842-abe0-582372433b12","Type":"ContainerStarted","Data":"6eee7c7bd5cab58f7f5c76d3b07d33e689398b83596545da6a2477f7335179cd"} Oct 30 23:35:17.387312 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:17.387282 5112 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:17.387621 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:17.387604 5112 scope.go:122] "RemoveContainer" containerID="9ec4e5b4f1696f28959221def8da02146a7e79ad3f307abb43ea50c3c1d701b6" Oct 30 23:35:17.387784 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:17.387765 5112 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-958pp_openshift-console-operator(707fcc17-c66a-458e-bcb5-8b3558dbe8c4)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" podUID="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" Oct 30 23:35:17.986388 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:17.986353 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-2ksc7" event={"ID":"ac81e307-c16f-4af8-bf87-f2c8bbaa8ab6","Type":"ContainerStarted","Data":"b6b2ea9ce5264d23ea87edeafde7a2ece7b5c6ca020722b8cd639b8296829882"} Oct 30 23:35:19.037539 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:19.037505 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:35:20.640784 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.640748 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:20.641199 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.641129 5112 scope.go:122] "RemoveContainer" containerID="9ec4e5b4f1696f28959221def8da02146a7e79ad3f307abb43ea50c3c1d701b6" Oct 30 23:35:20.641304 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:20.641282 5112 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-958pp_openshift-console-operator(707fcc17-c66a-458e-bcb5-8b3558dbe8c4)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" podUID="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" Oct 30 23:35:20.656385 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.656353 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:20.656385 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.656385 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:20.656565 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.656417 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:20.656565 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.656440 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:20.656565 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.656491 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:35:20.659026 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.658995 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/969fd947-a81d-4e6a-b369-550efce8f665-metrics-certs\") pod \"network-metrics-daemon-cf6r4\" (UID: \"969fd947-a81d-4e6a-b369-550efce8f665\") " pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:35:20.659132 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.658995 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\") pod \"image-registry-6749d98767-f4mjs\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:20.659169 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.659133 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4-metrics-certs\") pod \"router-default-5b5577b589-v98nd\" (UID: \"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4\") " pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:20.659320 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.659296 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb41b0b9-c085-4343-be37-07f224fc4f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkvsl\" (UID: \"fb41b0b9-c085-4343-be37-07f224fc4f8e\") " pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:20.659378 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.659360 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\") pod \"image-registry-865f789994-pzwps\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:20.686140 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.686120 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:20.687203 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.687185 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:20.689871 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.689850 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cf6r4" Oct 30 23:35:20.696189 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.696171 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:20.701409 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:20.701391 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gkvsl" Oct 30 23:35:21.012985 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:21.012956 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gkvsl"] Oct 30 23:35:21.018340 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:21.018313 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb41b0b9_c085_4343_be37_07f224fc4f8e.slice/crio-3c928f22cb0bcdbae2ea181aa6f8cac7ceacbae114926f972f19b171bc9a2066 WatchSource:0}: Error finding container 3c928f22cb0bcdbae2ea181aa6f8cac7ceacbae114926f972f19b171bc9a2066: Status 404 returned error can't find the container with id 3c928f22cb0bcdbae2ea181aa6f8cac7ceacbae114926f972f19b171bc9a2066 Oct 30 23:35:21.024777 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:21.024671 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cf6r4"] Oct 30 23:35:21.025485 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:21.025461 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b5577b589-v98nd"] Oct 30 23:35:21.027159 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:21.027139 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod969fd947_a81d_4e6a_b369_550efce8f665.slice/crio-120d422f521f3ea1f21dcd4764329b740c16cccde9e5c10305fa5d955a03137c WatchSource:0}: Error finding container 120d422f521f3ea1f21dcd4764329b740c16cccde9e5c10305fa5d955a03137c: Status 404 returned error can't find the container with id 120d422f521f3ea1f21dcd4764329b740c16cccde9e5c10305fa5d955a03137c Oct 30 23:35:21.033578 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:21.033557 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0588d5b_61b4_4ba0_8cc9_1e0db0c92bb4.slice/crio-d3d3567ee2dacfdd31e8761ff6446be4287783c4277a23e10fc05d6711c6dc38 WatchSource:0}: Error finding container d3d3567ee2dacfdd31e8761ff6446be4287783c4277a23e10fc05d6711c6dc38: Status 404 returned error can't find the container with id d3d3567ee2dacfdd31e8761ff6446be4287783c4277a23e10fc05d6711c6dc38 Oct 30 23:35:21.036087 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:21.036065 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6749d98767-f4mjs"] Oct 30 23:35:21.036972 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:21.036956 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-865f789994-pzwps"] Oct 30 23:35:21.040303 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:21.040287 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f5051b3_19d4_422e_a8d1_47129e287d57.slice/crio-185c770bd00687f85a94218231f162d2899721a88e4a914ed4c53e73e6c1cb01 WatchSource:0}: Error finding container 185c770bd00687f85a94218231f162d2899721a88e4a914ed4c53e73e6c1cb01: Status 404 returned error can't find the container with id 185c770bd00687f85a94218231f162d2899721a88e4a914ed4c53e73e6c1cb01 Oct 30 23:35:21.048172 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:21.048150 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a8da7c_7313_471b_8437_fff42cdbda65.slice/crio-98e43e9766da6e7103bcec681ce13b1472127d0ce7a242d75ef8744f476380c3 WatchSource:0}: Error finding container 98e43e9766da6e7103bcec681ce13b1472127d0ce7a242d75ef8744f476380c3: Status 404 returned error can't find the container with id 98e43e9766da6e7103bcec681ce13b1472127d0ce7a242d75ef8744f476380c3 Oct 30 23:35:22.002930 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:22.002897 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b5577b589-v98nd" event={"ID":"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4","Type":"ContainerStarted","Data":"51c4d398626bf5b2a157e73ad3444fe4d3e0405689fbe0d622b8192a81df1ff6"} Oct 30 23:35:22.003305 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:22.002991 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b5577b589-v98nd" event={"ID":"f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4","Type":"ContainerStarted","Data":"d3d3567ee2dacfdd31e8761ff6446be4287783c4277a23e10fc05d6711c6dc38"} Oct 30 23:35:22.004791 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:22.004766 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkvsl" event={"ID":"fb41b0b9-c085-4343-be37-07f224fc4f8e","Type":"ContainerStarted","Data":"4796f21025187839e084d0b0dcf4634a1e62a95e76f420c3f43e3c2d68cef808"} Oct 30 23:35:22.004888 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:22.004810 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkvsl" event={"ID":"fb41b0b9-c085-4343-be37-07f224fc4f8e","Type":"ContainerStarted","Data":"452ab404b76583cb94082209f6439aa3b005da78e70a4a053ee744d59fbc6365"} Oct 30 23:35:22.004888 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:22.004827 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkvsl" event={"ID":"fb41b0b9-c085-4343-be37-07f224fc4f8e","Type":"ContainerStarted","Data":"3c928f22cb0bcdbae2ea181aa6f8cac7ceacbae114926f972f19b171bc9a2066"} Oct 30 23:35:22.007005 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:22.006971 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865f789994-pzwps" event={"ID":"05a8da7c-7313-471b-8437-fff42cdbda65","Type":"ContainerStarted","Data":"cb6505e92af53eaa0906234d8cba3a2bace5219b1e654f2d16ea678d17dffd2a"} Oct 30 23:35:22.007126 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:22.007032 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865f789994-pzwps" event={"ID":"05a8da7c-7313-471b-8437-fff42cdbda65","Type":"ContainerStarted","Data":"98e43e9766da6e7103bcec681ce13b1472127d0ce7a242d75ef8744f476380c3"} Oct 30 23:35:22.008715 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:22.008689 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6749d98767-f4mjs" event={"ID":"2f5051b3-19d4-422e-a8d1-47129e287d57","Type":"ContainerStarted","Data":"cad0dea6d92355a2bd2fcdfb368fcb8b36428aa4722e6194f384dc04cbc6ef3a"} Oct 30 23:35:22.008793 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:22.008729 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6749d98767-f4mjs" event={"ID":"2f5051b3-19d4-422e-a8d1-47129e287d57","Type":"ContainerStarted","Data":"185c770bd00687f85a94218231f162d2899721a88e4a914ed4c53e73e6c1cb01"} Oct 30 23:35:22.010856 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:22.010832 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cf6r4" event={"ID":"969fd947-a81d-4e6a-b369-550efce8f665","Type":"ContainerStarted","Data":"bc8cdb286a4a3c5fe045b13fa39e753094c06792dd1f574f5b64af17640ec612"} Oct 30 23:35:22.010939 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:22.010877 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cf6r4" event={"ID":"969fd947-a81d-4e6a-b369-550efce8f665","Type":"ContainerStarted","Data":"120d422f521f3ea1f21dcd4764329b740c16cccde9e5c10305fa5d955a03137c"} Oct 30 23:35:22.686571 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:22.686539 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:22.689530 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:22.689506 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:23.016821 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:23.016797 5112 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 23:35:23.016821 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:23.016806 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cf6r4" event={"ID":"969fd947-a81d-4e6a-b369-550efce8f665","Type":"ContainerStarted","Data":"dc72db14c2536b6168c4e41092d11132bcc51fcdd5577b83307a55b908c939bd"} Oct 30 23:35:23.017365 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:23.016845 5112 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 23:35:24.022749 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:24.022706 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkvsl" event={"ID":"fb41b0b9-c085-4343-be37-07f224fc4f8e","Type":"ContainerStarted","Data":"6359af1672558ab5dc7885acc94e6f8f2fb35630218f1c3f934b39a88bfcde7f"} Oct 30 23:35:24.023104 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:24.022767 5112 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 23:35:24.869390 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:24.869360 5112 scope.go:122] "RemoveContainer" containerID="9ec4e5b4f1696f28959221def8da02146a7e79ad3f307abb43ea50c3c1d701b6" Oct 30 23:35:25.027716 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:25.027687 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/2.log" Oct 30 23:35:25.028101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:25.027816 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" event={"ID":"707fcc17-c66a-458e-bcb5-8b3558dbe8c4","Type":"ContainerStarted","Data":"d4001177a21d3e1378ec85eaeab9005f6675f05ebd3d85b7010a5a7d46cebb66"} Oct 30 23:35:25.028235 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:25.028214 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:25.029089 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:25.029062 5112 patch_prober.go:29] interesting pod/console-operator-7cd56b8dbc-958pp container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" start-of-body= Oct 30 23:35:25.029181 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:25.029104 5112 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" podUID="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" Oct 30 23:35:26.032343 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.032302 5112 patch_prober.go:29] interesting pod/console-operator-7cd56b8dbc-958pp container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" start-of-body= Oct 30 23:35:26.032815 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.032352 5112 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" podUID="707fcc17-c66a-458e-bcb5-8b3558dbe8c4" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" Oct 30 23:35:26.115908 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.115881 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:26.503913 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.503881 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-nfsxz-6f4bq"] Oct 30 23:35:26.509066 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.509028 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:35:26.520776 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.520754 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7kb7x"] Oct 30 23:35:26.524393 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.524372 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7kb7x" Oct 30 23:35:26.532567 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.532546 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-865f789994-pzwps"] Oct 30 23:35:26.532688 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.532665 5112 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 23:35:26.543870 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.538246 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-nfsxz-6f4bq"] Oct 30 23:35:26.546018 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.545693 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7kb7x"] Oct 30 23:35:26.578702 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.578680 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Oct 30 23:35:26.578821 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.578730 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ghmm2\"" Oct 30 23:35:26.603346 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.603325 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csscz\" (UniqueName: \"kubernetes.io/projected/049ece3c-3f2f-47a8-a0f4-5f2904b66755-kube-api-access-csscz\") pod \"periodic-gathering-nfsxz-6f4bq\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:35:26.603473 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.603362 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9c12b085-8616-40a6-85a2-2c2c88f59389-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-7kb7x\" (UID: \"9c12b085-8616-40a6-85a2-2c2c88f59389\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7kb7x" Oct 30 23:35:26.603473 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.603385 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/049ece3c-3f2f-47a8-a0f4-5f2904b66755-service-ca-bundle\") pod \"periodic-gathering-nfsxz-6f4bq\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:35:26.603473 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.603445 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/049ece3c-3f2f-47a8-a0f4-5f2904b66755-trusted-ca-bundle\") pod \"periodic-gathering-nfsxz-6f4bq\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:35:26.603591 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.603531 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/049ece3c-3f2f-47a8-a0f4-5f2904b66755-archives-path\") pod \"periodic-gathering-nfsxz-6f4bq\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:35:26.623916 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.623896 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:26.624008 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.623993 5112 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 23:35:26.625224 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.625209 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b5577b589-v98nd" Oct 30 23:35:26.640965 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.640945 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8474d594fc-nnvg9"] Oct 30 23:35:26.644536 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.644518 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.670953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.670929 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8474d594fc-nnvg9"] Oct 30 23:35:26.704459 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.704426 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csscz\" (UniqueName: \"kubernetes.io/projected/049ece3c-3f2f-47a8-a0f4-5f2904b66755-kube-api-access-csscz\") pod \"periodic-gathering-nfsxz-6f4bq\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:35:26.704739 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.704469 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fktkq\" (UniqueName: \"kubernetes.io/projected/a852725c-b95d-456e-9885-2cbc2a55d6b8-kube-api-access-fktkq\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.704739 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.704569 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a852725c-b95d-456e-9885-2cbc2a55d6b8-registry-certificates\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.704739 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.704661 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a852725c-b95d-456e-9885-2cbc2a55d6b8-trusted-ca\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.704739 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.704727 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a852725c-b95d-456e-9885-2cbc2a55d6b8-installation-pull-secrets\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.704931 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.704764 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a852725c-b95d-456e-9885-2cbc2a55d6b8-registry-tls\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.704993 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.704976 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a852725c-b95d-456e-9885-2cbc2a55d6b8-image-registry-private-configuration\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.705077 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.705060 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9c12b085-8616-40a6-85a2-2c2c88f59389-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-7kb7x\" (UID: \"9c12b085-8616-40a6-85a2-2c2c88f59389\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7kb7x" Oct 30 23:35:26.705146 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.705103 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/049ece3c-3f2f-47a8-a0f4-5f2904b66755-service-ca-bundle\") pod \"periodic-gathering-nfsxz-6f4bq\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:35:26.705146 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.705132 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a852725c-b95d-456e-9885-2cbc2a55d6b8-ca-trust-extracted\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.705246 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.705177 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a852725c-b95d-456e-9885-2cbc2a55d6b8-bound-sa-token\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.705300 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.705270 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/049ece3c-3f2f-47a8-a0f4-5f2904b66755-trusted-ca-bundle\") pod \"periodic-gathering-nfsxz-6f4bq\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:35:26.705353 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.705335 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/049ece3c-3f2f-47a8-a0f4-5f2904b66755-archives-path\") pod \"periodic-gathering-nfsxz-6f4bq\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:35:26.705792 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.705746 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/049ece3c-3f2f-47a8-a0f4-5f2904b66755-archives-path\") pod \"periodic-gathering-nfsxz-6f4bq\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:35:26.706219 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.706180 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/049ece3c-3f2f-47a8-a0f4-5f2904b66755-service-ca-bundle\") pod \"periodic-gathering-nfsxz-6f4bq\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:35:26.706593 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.706577 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/049ece3c-3f2f-47a8-a0f4-5f2904b66755-trusted-ca-bundle\") pod \"periodic-gathering-nfsxz-6f4bq\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:35:26.707800 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.707777 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9c12b085-8616-40a6-85a2-2c2c88f59389-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-7kb7x\" (UID: \"9c12b085-8616-40a6-85a2-2c2c88f59389\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7kb7x" Oct 30 23:35:26.740459 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.740434 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csscz\" (UniqueName: \"kubernetes.io/projected/049ece3c-3f2f-47a8-a0f4-5f2904b66755-kube-api-access-csscz\") pod \"periodic-gathering-nfsxz-6f4bq\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:35:26.807190 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.807107 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a852725c-b95d-456e-9885-2cbc2a55d6b8-image-registry-private-configuration\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.807190 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.807165 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a852725c-b95d-456e-9885-2cbc2a55d6b8-ca-trust-extracted\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.807346 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.807207 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a852725c-b95d-456e-9885-2cbc2a55d6b8-bound-sa-token\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.807346 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.807284 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fktkq\" (UniqueName: \"kubernetes.io/projected/a852725c-b95d-456e-9885-2cbc2a55d6b8-kube-api-access-fktkq\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.807346 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.807314 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a852725c-b95d-456e-9885-2cbc2a55d6b8-registry-certificates\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.807346 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.807338 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a852725c-b95d-456e-9885-2cbc2a55d6b8-trusted-ca\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.807483 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.807363 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a852725c-b95d-456e-9885-2cbc2a55d6b8-installation-pull-secrets\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.807483 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.807388 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a852725c-b95d-456e-9885-2cbc2a55d6b8-registry-tls\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.808099 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.808070 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a852725c-b95d-456e-9885-2cbc2a55d6b8-ca-trust-extracted\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.808809 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.808785 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a852725c-b95d-456e-9885-2cbc2a55d6b8-registry-certificates\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.810017 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.809585 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a852725c-b95d-456e-9885-2cbc2a55d6b8-trusted-ca\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.812474 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.812450 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a852725c-b95d-456e-9885-2cbc2a55d6b8-registry-tls\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.812621 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.812594 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a852725c-b95d-456e-9885-2cbc2a55d6b8-installation-pull-secrets\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.813844 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.813799 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a852725c-b95d-456e-9885-2cbc2a55d6b8-image-registry-private-configuration\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.822975 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.822948 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:35:26.829622 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.829598 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a852725c-b95d-456e-9885-2cbc2a55d6b8-bound-sa-token\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.830212 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.830193 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fktkq\" (UniqueName: \"kubernetes.io/projected/a852725c-b95d-456e-9885-2cbc2a55d6b8-kube-api-access-fktkq\") pod \"image-registry-8474d594fc-nnvg9\" (UID: \"a852725c-b95d-456e-9885-2cbc2a55d6b8\") " pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.837944 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.837922 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7kb7x" Oct 30 23:35:26.956472 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.956448 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:26.989126 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:26.989099 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qpgjl" Oct 30 23:35:27.137111 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:27.136365 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-nfsxz-6f4bq"] Oct 30 23:35:27.146911 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:27.146166 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7kb7x"] Oct 30 23:35:27.149901 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:27.149874 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod049ece3c_3f2f_47a8_a0f4_5f2904b66755.slice/crio-13e8c4f3455356ce7144be122b272c7b15d9186f8b64bba707695479d283244d WatchSource:0}: Error finding container 13e8c4f3455356ce7144be122b272c7b15d9186f8b64bba707695479d283244d: Status 404 returned error can't find the container with id 13e8c4f3455356ce7144be122b272c7b15d9186f8b64bba707695479d283244d Oct 30 23:35:27.151506 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:27.151479 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c12b085_8616_40a6_85a2_2c2c88f59389.slice/crio-d7aec898b1729af87efb26673ab1f2284adf5df3b0e206d79b5d7e2094c1dfce WatchSource:0}: Error finding container d7aec898b1729af87efb26673ab1f2284adf5df3b0e206d79b5d7e2094c1dfce: Status 404 returned error can't find the container with id d7aec898b1729af87efb26673ab1f2284adf5df3b0e206d79b5d7e2094c1dfce Oct 30 23:35:27.262169 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:27.262131 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8474d594fc-nnvg9"] Oct 30 23:35:27.266364 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:27.266334 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda852725c_b95d_456e_9885_2cbc2a55d6b8.slice/crio-f44540e4bae10eeb3f5bc2442e58ec364014bac3217586ad93095b1c8fd8d9ab WatchSource:0}: Error finding container f44540e4bae10eeb3f5bc2442e58ec364014bac3217586ad93095b1c8fd8d9ab: Status 404 returned error can't find the container with id f44540e4bae10eeb3f5bc2442e58ec364014bac3217586ad93095b1c8fd8d9ab Oct 30 23:35:27.928059 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:27.928022 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:28.042698 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:28.042659 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" event={"ID":"a852725c-b95d-456e-9885-2cbc2a55d6b8","Type":"ContainerStarted","Data":"3fa0d1537e1937759f3145a88af433d089879e4712a2b3d2d83ff6c93cd7805b"} Oct 30 23:35:28.042864 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:28.042720 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" event={"ID":"a852725c-b95d-456e-9885-2cbc2a55d6b8","Type":"ContainerStarted","Data":"f44540e4bae10eeb3f5bc2442e58ec364014bac3217586ad93095b1c8fd8d9ab"} Oct 30 23:35:28.042933 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:28.042863 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:28.044268 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:28.044242 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7kb7x" event={"ID":"9c12b085-8616-40a6-85a2-2c2c88f59389","Type":"ContainerStarted","Data":"d7aec898b1729af87efb26673ab1f2284adf5df3b0e206d79b5d7e2094c1dfce"} Oct 30 23:35:28.045976 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:28.045945 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" event={"ID":"049ece3c-3f2f-47a8-a0f4-5f2904b66755","Type":"ContainerStarted","Data":"93d073df8e2ee21028a35073e584e1f9c38602808303099fbabbbbbcfcfcc2b0"} Oct 30 23:35:28.046118 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:28.045986 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" event={"ID":"049ece3c-3f2f-47a8-a0f4-5f2904b66755","Type":"ContainerStarted","Data":"13e8c4f3455356ce7144be122b272c7b15d9186f8b64bba707695479d283244d"} Oct 30 23:35:28.084894 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:28.084850 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" podStartSLOduration=2.08483832 podStartE2EDuration="2.08483832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:28.084483334 +0000 UTC m=+16.348388906" watchObservedRunningTime="2026-10-30 23:35:28.08483832 +0000 UTC m=+16.348743892" Oct 30 23:35:28.119658 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:28.119615 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" podStartSLOduration=2.119603427 podStartE2EDuration="2.119603427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:28.119140594 +0000 UTC m=+16.383046166" watchObservedRunningTime="2026-10-30 23:35:28.119603427 +0000 UTC m=+16.383508999" Oct 30 23:35:29.051552 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:29.051509 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7kb7x" event={"ID":"9c12b085-8616-40a6-85a2-2c2c88f59389","Type":"ContainerStarted","Data":"3d50bef42c418bd84741ab0702efc5f047b3f890e1762fbfef5502a67ab0c06a"} Oct 30 23:35:29.051989 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:29.051800 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7kb7x" Oct 30 23:35:29.055996 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:29.055962 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7kb7x" Oct 30 23:35:29.087220 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:29.087178 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7kb7x" podStartSLOduration=2.126682916 podStartE2EDuration="3.087166149s" totalImagesPullingTime="960.483233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:29.086962249 +0000 UTC m=+17.350867820" watchObservedRunningTime="2026-10-30 23:35:29.087166149 +0000 UTC m=+17.351071720" Oct 30 23:35:29.167518 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:29.167497 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vljc" Oct 30 23:35:29.384204 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:29.384109 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qpgjl_b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d/dns/0.log" Oct 30 23:35:29.584687 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:29.584649 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qpgjl_b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d/kube-rbac-proxy/0.log" Oct 30 23:35:30.584201 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:30.584172 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kh84m_fc6ae729-bb57-4d5f-9112-69dc5d0abee9/dns-node-resolver/0.log" Oct 30 23:35:30.784025 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:30.783995 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6749d98767-f4mjs_2f5051b3-19d4-422e-a8d1-47129e287d57/registry/0.log" Oct 30 23:35:30.984995 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:30.984922 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8474d594fc-nnvg9_a852725c-b95d-456e-9885-2cbc2a55d6b8/registry/0.log" Oct 30 23:35:31.187199 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:31.187169 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-865f789994-pzwps_05a8da7c-7313-471b-8437-fff42cdbda65/registry/0.log" Oct 30 23:35:31.784573 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:31.784497 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xcbst_c9448c7a-5b0e-4ff7-808b-889a0d8b022f/node-ca/0.log" Oct 30 23:35:31.984837 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:31.984811 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5577b589-v98nd_f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/router/0.log" Oct 30 23:35:32.384225 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:32.384182 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m5ssb_55a2d22b-ecf1-4974-b8d2-5827f9ee4ee5/serve-healthcheck-canary/0.log" Oct 30 23:35:34.306905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.306873 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zrvd9"] Oct 30 23:35:34.313877 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.313851 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.376437 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.376413 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 23:35:34.376437 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.376445 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 23:35:34.376632 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.376507 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 23:35:34.376632 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.376602 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 23:35:34.376632 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.376612 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9kbs4\"" Oct 30 23:35:34.466281 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.466258 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/efededbb-ac34-495f-8965-5d7712567dbf-node-exporter-accelerators-collector-config\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.466433 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.466288 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/efededbb-ac34-495f-8965-5d7712567dbf-root\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.466433 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.466312 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efededbb-ac34-495f-8965-5d7712567dbf-sys\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.466433 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.466327 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efededbb-ac34-495f-8965-5d7712567dbf-metrics-client-ca\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.466433 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.466422 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/efededbb-ac34-495f-8965-5d7712567dbf-node-exporter-textfile\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.466631 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.466478 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efededbb-ac34-495f-8965-5d7712567dbf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.466631 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.466536 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/efededbb-ac34-495f-8965-5d7712567dbf-node-exporter-wtmp\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.466631 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.466597 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sv48\" (UniqueName: \"kubernetes.io/projected/efededbb-ac34-495f-8965-5d7712567dbf-kube-api-access-5sv48\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.466736 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.466692 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efededbb-ac34-495f-8965-5d7712567dbf-node-exporter-tls\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.567890 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.567818 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efededbb-ac34-495f-8965-5d7712567dbf-node-exporter-tls\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.567890 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.567867 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/efededbb-ac34-495f-8965-5d7712567dbf-node-exporter-accelerators-collector-config\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.568105 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.567898 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/efededbb-ac34-495f-8965-5d7712567dbf-root\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.568105 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.567927 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efededbb-ac34-495f-8965-5d7712567dbf-sys\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.568105 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.567948 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efededbb-ac34-495f-8965-5d7712567dbf-metrics-client-ca\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.568105 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.567977 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/efededbb-ac34-495f-8965-5d7712567dbf-node-exporter-textfile\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.568105 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.568007 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efededbb-ac34-495f-8965-5d7712567dbf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.568105 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.568010 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/efededbb-ac34-495f-8965-5d7712567dbf-root\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.568105 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.568031 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efededbb-ac34-495f-8965-5d7712567dbf-sys\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.568105 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.568033 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/efededbb-ac34-495f-8965-5d7712567dbf-node-exporter-wtmp\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.568484 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.568174 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/efededbb-ac34-495f-8965-5d7712567dbf-node-exporter-wtmp\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.568484 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.568191 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sv48\" (UniqueName: \"kubernetes.io/projected/efededbb-ac34-495f-8965-5d7712567dbf-kube-api-access-5sv48\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.568484 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.568476 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/efededbb-ac34-495f-8965-5d7712567dbf-node-exporter-textfile\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.568690 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.568663 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/efededbb-ac34-495f-8965-5d7712567dbf-node-exporter-accelerators-collector-config\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.568818 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.568666 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efededbb-ac34-495f-8965-5d7712567dbf-metrics-client-ca\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.570188 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.570166 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efededbb-ac34-495f-8965-5d7712567dbf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.570443 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.570423 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efededbb-ac34-495f-8965-5d7712567dbf-node-exporter-tls\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.586196 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.586169 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sv48\" (UniqueName: \"kubernetes.io/projected/efededbb-ac34-495f-8965-5d7712567dbf-kube-api-access-5sv48\") pod \"node-exporter-zrvd9\" (UID: \"efededbb-ac34-495f-8965-5d7712567dbf\") " pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.633115 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:34.633090 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zrvd9" Oct 30 23:35:34.648183 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:35:34.648161 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefededbb_ac34_495f_8965_5d7712567dbf.slice/crio-1192599734c263ff9ef0bd09028e697269b6ced170c1b2bf1c3689c18f018530 WatchSource:0}: Error finding container 1192599734c263ff9ef0bd09028e697269b6ced170c1b2bf1c3689c18f018530: Status 404 returned error can't find the container with id 1192599734c263ff9ef0bd09028e697269b6ced170c1b2bf1c3689c18f018530 Oct 30 23:35:35.075757 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:35.075718 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zrvd9" event={"ID":"efededbb-ac34-495f-8965-5d7712567dbf","Type":"ContainerStarted","Data":"1192599734c263ff9ef0bd09028e697269b6ced170c1b2bf1c3689c18f018530"} Oct 30 23:35:36.035977 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:36.035949 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-958pp" Oct 30 23:35:36.082460 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:36.082428 5112 generic.go:356] "Generic (PLEG): container finished" podID="efededbb-ac34-495f-8965-5d7712567dbf" containerID="e6cc662b9471919db571fb28d7e597e1a75791ee075dd256c67d52684b0010e8" exitCode=0 Oct 30 23:35:36.082607 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:36.082527 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zrvd9" event={"ID":"efededbb-ac34-495f-8965-5d7712567dbf","Type":"ContainerDied","Data":"e6cc662b9471919db571fb28d7e597e1a75791ee075dd256c67d52684b0010e8"} Oct 30 23:35:36.120687 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:36.120668 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:35:37.089327 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:37.089290 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zrvd9" event={"ID":"efededbb-ac34-495f-8965-5d7712567dbf","Type":"ContainerStarted","Data":"443d2ba460e0eb8e4c230e7370133cc424c4c30e374651fb4b2e95acbc645bfb"} Oct 30 23:35:37.089790 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:37.089344 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zrvd9" event={"ID":"efededbb-ac34-495f-8965-5d7712567dbf","Type":"ContainerStarted","Data":"f4bcf844548363e65b6db2ec77c73d6225a1c39e038cf53666b35eb8eee9c4eb"} Oct 30 23:35:37.153308 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:37.153257 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zrvd9" podStartSLOduration=2.20874988 podStartE2EDuration="3.153244896s" totalImagesPullingTime="878.603237ms" totalInitContainerRuntime="65.891779ms" isStatefulPod=true podCreationTimestamp="2026-10-30 23:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:37.152321886 +0000 UTC m=+25.416227457" watchObservedRunningTime="2026-10-30 23:35:37.153244896 +0000 UTC m=+25.417150468" Oct 30 23:35:37.933741 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:37.933714 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:39.040174 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:39.040148 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2rjct" Oct 30 23:35:40.953890 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:40.953863 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tmkjs" Oct 30 23:35:49.059010 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:49.058968 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8474d594fc-nnvg9" Oct 30 23:35:49.142802 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:49.142771 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6749d98767-f4mjs"] Oct 30 23:35:51.557222 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.557171 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-865f789994-pzwps" podUID="05a8da7c-7313-471b-8437-fff42cdbda65" containerName="registry" containerID="cri-o://cb6505e92af53eaa0906234d8cba3a2bace5219b1e654f2d16ea678d17dffd2a" gracePeriod=30 Oct 30 23:35:51.798305 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.798276 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:51.921564 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.921494 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-trusted-ca\") pod \"05a8da7c-7313-471b-8437-fff42cdbda65\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " Oct 30 23:35:51.921564 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.921548 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\") pod \"05a8da7c-7313-471b-8437-fff42cdbda65\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " Oct 30 23:35:51.921890 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.921570 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-registry-certificates\") pod \"05a8da7c-7313-471b-8437-fff42cdbda65\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " Oct 30 23:35:51.921890 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.921719 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-bound-sa-token\") pod \"05a8da7c-7313-471b-8437-fff42cdbda65\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " Oct 30 23:35:51.921890 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.921770 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-installation-pull-secrets\") pod \"05a8da7c-7313-471b-8437-fff42cdbda65\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " Oct 30 23:35:51.921890 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.921810 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-kube-api-access-gjs9k\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-kube-api-access-gjs9k\") pod \"05a8da7c-7313-471b-8437-fff42cdbda65\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " Oct 30 23:35:51.921890 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.921834 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-image-registry-private-configuration\") pod \"05a8da7c-7313-471b-8437-fff42cdbda65\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " Oct 30 23:35:51.921890 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.921860 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05a8da7c-7313-471b-8437-fff42cdbda65-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/05a8da7c-7313-471b-8437-fff42cdbda65-ca-trust-extracted\") pod \"05a8da7c-7313-471b-8437-fff42cdbda65\" (UID: \"05a8da7c-7313-471b-8437-fff42cdbda65\") " Oct 30 23:35:51.922225 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.921903 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-registry-certificates" pod "05a8da7c-7313-471b-8437-fff42cdbda65" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:35:51.922225 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.921944 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-trusted-ca" pod "05a8da7c-7313-471b-8437-fff42cdbda65" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:35:51.922225 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.922141 5112 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-trusted-ca\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:35:51.922225 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.922162 5112 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/05a8da7c-7313-471b-8437-fff42cdbda65-registry-certificates\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:35:51.924282 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.924213 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-kube-api-access-gjs9k" pod "05a8da7c-7313-471b-8437-fff42cdbda65" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65"). InnerVolumeSpecName "kube-api-access-gjs9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:35:51.924404 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.924358 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-bound-sa-token" pod "05a8da7c-7313-471b-8437-fff42cdbda65" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:35:51.924404 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.924383 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-installation-pull-secrets" pod "05a8da7c-7313-471b-8437-fff42cdbda65" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:35:51.924499 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.924388 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls" pod "05a8da7c-7313-471b-8437-fff42cdbda65" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:35:51.924499 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.924470 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-image-registry-private-configuration" pod "05a8da7c-7313-471b-8437-fff42cdbda65" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:35:51.930562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:51.930536 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a8da7c-7313-471b-8437-fff42cdbda65-ca-trust-extracted" pod "05a8da7c-7313-471b-8437-fff42cdbda65" (UID: "05a8da7c-7313-471b-8437-fff42cdbda65"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:35:52.023172 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:52.023148 5112 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/05a8da7c-7313-471b-8437-fff42cdbda65-ca-trust-extracted\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:35:52.023172 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:52.023169 5112 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-registry-tls\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:35:52.023304 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:52.023179 5112 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-bound-sa-token\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:35:52.023304 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:52.023188 5112 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-installation-pull-secrets\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:35:52.023304 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:52.023196 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjs9k\" (UniqueName: \"kubernetes.io/projected/05a8da7c-7313-471b-8437-fff42cdbda65-kube-api-access-gjs9k\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:35:52.023304 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:52.023205 5112 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/05a8da7c-7313-471b-8437-fff42cdbda65-image-registry-private-configuration\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:35:52.149452 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:52.149431 5112 generic.go:356] "Generic (PLEG): container finished" podID="05a8da7c-7313-471b-8437-fff42cdbda65" containerID="cb6505e92af53eaa0906234d8cba3a2bace5219b1e654f2d16ea678d17dffd2a" exitCode=0 Oct 30 23:35:52.149547 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:52.149475 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865f789994-pzwps" Oct 30 23:35:52.149547 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:52.149477 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865f789994-pzwps" event={"ID":"05a8da7c-7313-471b-8437-fff42cdbda65","Type":"ContainerDied","Data":"cb6505e92af53eaa0906234d8cba3a2bace5219b1e654f2d16ea678d17dffd2a"} Oct 30 23:35:52.149547 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:52.149512 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865f789994-pzwps" event={"ID":"05a8da7c-7313-471b-8437-fff42cdbda65","Type":"ContainerDied","Data":"98e43e9766da6e7103bcec681ce13b1472127d0ce7a242d75ef8744f476380c3"} Oct 30 23:35:52.149547 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:52.149530 5112 scope.go:122] "RemoveContainer" containerID="cb6505e92af53eaa0906234d8cba3a2bace5219b1e654f2d16ea678d17dffd2a" Oct 30 23:35:52.158078 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:52.158064 5112 scope.go:122] "RemoveContainer" containerID="cb6505e92af53eaa0906234d8cba3a2bace5219b1e654f2d16ea678d17dffd2a" Oct 30 23:35:52.158315 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:52.158295 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb6505e92af53eaa0906234d8cba3a2bace5219b1e654f2d16ea678d17dffd2a\": container with ID starting with cb6505e92af53eaa0906234d8cba3a2bace5219b1e654f2d16ea678d17dffd2a not found: ID does not exist" containerID="cb6505e92af53eaa0906234d8cba3a2bace5219b1e654f2d16ea678d17dffd2a" Oct 30 23:35:52.158380 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:52.158325 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb6505e92af53eaa0906234d8cba3a2bace5219b1e654f2d16ea678d17dffd2a"} err="failed to get container status \"cb6505e92af53eaa0906234d8cba3a2bace5219b1e654f2d16ea678d17dffd2a\": rpc error: code = NotFound desc = could not find container \"cb6505e92af53eaa0906234d8cba3a2bace5219b1e654f2d16ea678d17dffd2a\": container with ID starting with cb6505e92af53eaa0906234d8cba3a2bace5219b1e654f2d16ea678d17dffd2a not found: ID does not exist" Oct 30 23:35:52.200149 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:52.200097 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-865f789994-pzwps"] Oct 30 23:35:52.203984 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:52.203961 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-865f789994-pzwps"] Oct 30 23:35:52.977723 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:35:52.977641 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:35:53.875185 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:35:53.875145 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="05a8da7c-7313-471b-8437-fff42cdbda65" path="/var/lib/kubelet/pods/05a8da7c-7313-471b-8437-fff42cdbda65/volumes" Oct 30 23:36:00.124434 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:00.124395 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-tb5lv-n7p5n"] Oct 30 23:36:00.124909 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:00.124631 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" podUID="3549b0b4-488b-4819-b37a-8a566c3d5514" containerName="insights-gathering" containerID="cri-o://f60ba745edbb8a33ac60f67e681bd61c037561fc3ee45886786b63d8dea62624" gracePeriod=30 Oct 30 23:36:00.365748 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:00.365724 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:36:00.485005 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:00.484951 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-trusted-ca-bundle\") pod \"3549b0b4-488b-4819-b37a-8a566c3d5514\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " Oct 30 23:36:00.485130 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:00.485031 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3549b0b4-488b-4819-b37a-8a566c3d5514-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3549b0b4-488b-4819-b37a-8a566c3d5514-archives-path\") pod \"3549b0b4-488b-4819-b37a-8a566c3d5514\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " Oct 30 23:36:00.485130 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:00.485074 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3549b0b4-488b-4819-b37a-8a566c3d5514-kube-api-access-vtchh\" (UniqueName: \"kubernetes.io/projected/3549b0b4-488b-4819-b37a-8a566c3d5514-kube-api-access-vtchh\") pod \"3549b0b4-488b-4819-b37a-8a566c3d5514\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " Oct 30 23:36:00.485201 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:00.485138 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-service-ca-bundle\") pod \"3549b0b4-488b-4819-b37a-8a566c3d5514\" (UID: \"3549b0b4-488b-4819-b37a-8a566c3d5514\") " Oct 30 23:36:00.485360 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:00.485336 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3549b0b4-488b-4819-b37a-8a566c3d5514-archives-path" pod "3549b0b4-488b-4819-b37a-8a566c3d5514" (UID: "3549b0b4-488b-4819-b37a-8a566c3d5514"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:36:00.485393 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:00.485375 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-trusted-ca-bundle" pod "3549b0b4-488b-4819-b37a-8a566c3d5514" (UID: "3549b0b4-488b-4819-b37a-8a566c3d5514"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:36:00.485541 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:00.485520 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-service-ca-bundle" pod "3549b0b4-488b-4819-b37a-8a566c3d5514" (UID: "3549b0b4-488b-4819-b37a-8a566c3d5514"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:36:00.487373 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:00.487345 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3549b0b4-488b-4819-b37a-8a566c3d5514-kube-api-access-vtchh" pod "3549b0b4-488b-4819-b37a-8a566c3d5514" (UID: "3549b0b4-488b-4819-b37a-8a566c3d5514"). InnerVolumeSpecName "kube-api-access-vtchh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:36:00.586189 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:00.586165 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtchh\" (UniqueName: \"kubernetes.io/projected/3549b0b4-488b-4819-b37a-8a566c3d5514-kube-api-access-vtchh\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:00.586189 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:00.586186 5112 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-service-ca-bundle\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:00.586320 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:00.586197 5112 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3549b0b4-488b-4819-b37a-8a566c3d5514-trusted-ca-bundle\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:00.586320 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:00.586206 5112 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3549b0b4-488b-4819-b37a-8a566c3d5514-archives-path\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:01.189990 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:01.189954 5112 generic.go:356] "Generic (PLEG): container finished" podID="3549b0b4-488b-4819-b37a-8a566c3d5514" containerID="f60ba745edbb8a33ac60f67e681bd61c037561fc3ee45886786b63d8dea62624" exitCode=2 Oct 30 23:36:01.190441 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:01.190025 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" Oct 30 23:36:01.190441 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:01.190030 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" event={"ID":"3549b0b4-488b-4819-b37a-8a566c3d5514","Type":"ContainerDied","Data":"f60ba745edbb8a33ac60f67e681bd61c037561fc3ee45886786b63d8dea62624"} Oct 30 23:36:01.190441 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:01.190199 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-tb5lv-n7p5n" event={"ID":"3549b0b4-488b-4819-b37a-8a566c3d5514","Type":"ContainerDied","Data":"19e49b903e4ec8feb935e7992b2694f45944d5bc91916ad12270fd5ae3205eac"} Oct 30 23:36:01.190441 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:01.190242 5112 scope.go:122] "RemoveContainer" containerID="f60ba745edbb8a33ac60f67e681bd61c037561fc3ee45886786b63d8dea62624" Oct 30 23:36:01.201306 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:01.201282 5112 scope.go:122] "RemoveContainer" containerID="f60ba745edbb8a33ac60f67e681bd61c037561fc3ee45886786b63d8dea62624" Oct 30 23:36:01.201651 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:36:01.201632 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f60ba745edbb8a33ac60f67e681bd61c037561fc3ee45886786b63d8dea62624\": container with ID starting with f60ba745edbb8a33ac60f67e681bd61c037561fc3ee45886786b63d8dea62624 not found: ID does not exist" containerID="f60ba745edbb8a33ac60f67e681bd61c037561fc3ee45886786b63d8dea62624" Oct 30 23:36:01.201722 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:01.201663 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f60ba745edbb8a33ac60f67e681bd61c037561fc3ee45886786b63d8dea62624"} err="failed to get container status \"f60ba745edbb8a33ac60f67e681bd61c037561fc3ee45886786b63d8dea62624\": rpc error: code = NotFound desc = could not find container \"f60ba745edbb8a33ac60f67e681bd61c037561fc3ee45886786b63d8dea62624\": container with ID starting with f60ba745edbb8a33ac60f67e681bd61c037561fc3ee45886786b63d8dea62624 not found: ID does not exist" Oct 30 23:36:01.237626 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:01.237595 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-tb5lv-n7p5n"] Oct 30 23:36:01.249261 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:01.249239 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-tb5lv-n7p5n"] Oct 30 23:36:01.874568 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:01.874536 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3549b0b4-488b-4819-b37a-8a566c3d5514" path="/var/lib/kubelet/pods/3549b0b4-488b-4819-b37a-8a566c3d5514/volumes" Oct 30 23:36:14.171475 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.171413 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6749d98767-f4mjs" podUID="2f5051b3-19d4-422e-a8d1-47129e287d57" containerName="registry" containerID="cri-o://cad0dea6d92355a2bd2fcdfb368fcb8b36428aa4722e6194f384dc04cbc6ef3a" gracePeriod=30 Oct 30 23:36:14.409991 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.409965 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:36:14.479107 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.479056 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-kube-api-access-gpvhk\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-kube-api-access-gpvhk\") pod \"2f5051b3-19d4-422e-a8d1-47129e287d57\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " Oct 30 23:36:14.479107 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.479092 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-certificates\") pod \"2f5051b3-19d4-422e-a8d1-47129e287d57\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " Oct 30 23:36:14.479286 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.479113 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-installation-pull-secrets\") pod \"2f5051b3-19d4-422e-a8d1-47129e287d57\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " Oct 30 23:36:14.479286 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.479142 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\") pod \"2f5051b3-19d4-422e-a8d1-47129e287d57\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " Oct 30 23:36:14.479394 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.479284 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-image-registry-private-configuration\") pod \"2f5051b3-19d4-422e-a8d1-47129e287d57\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " Oct 30 23:36:14.479394 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.479320 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-trusted-ca\") pod \"2f5051b3-19d4-422e-a8d1-47129e287d57\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " Oct 30 23:36:14.479394 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.479383 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f5051b3-19d4-422e-a8d1-47129e287d57-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f5051b3-19d4-422e-a8d1-47129e287d57-ca-trust-extracted\") pod \"2f5051b3-19d4-422e-a8d1-47129e287d57\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " Oct 30 23:36:14.479562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.479415 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-bound-sa-token\") pod \"2f5051b3-19d4-422e-a8d1-47129e287d57\" (UID: \"2f5051b3-19d4-422e-a8d1-47129e287d57\") " Oct 30 23:36:14.479562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.479532 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-certificates" pod "2f5051b3-19d4-422e-a8d1-47129e287d57" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:36:14.479819 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.479761 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-trusted-ca" pod "2f5051b3-19d4-422e-a8d1-47129e287d57" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:36:14.479891 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.479835 5112 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-certificates\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:14.479891 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.479855 5112 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f5051b3-19d4-422e-a8d1-47129e287d57-trusted-ca\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:14.481734 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.481707 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls" pod "2f5051b3-19d4-422e-a8d1-47129e287d57" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:36:14.481844 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.481741 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-kube-api-access-gpvhk" pod "2f5051b3-19d4-422e-a8d1-47129e287d57" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57"). InnerVolumeSpecName "kube-api-access-gpvhk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:36:14.482107 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.482076 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-image-registry-private-configuration" pod "2f5051b3-19d4-422e-a8d1-47129e287d57" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:36:14.482107 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.482099 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-bound-sa-token" pod "2f5051b3-19d4-422e-a8d1-47129e287d57" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:36:14.482242 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.482193 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-installation-pull-secrets" pod "2f5051b3-19d4-422e-a8d1-47129e287d57" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:36:14.486852 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.486832 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f5051b3-19d4-422e-a8d1-47129e287d57-ca-trust-extracted" pod "2f5051b3-19d4-422e-a8d1-47129e287d57" (UID: "2f5051b3-19d4-422e-a8d1-47129e287d57"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:36:14.580992 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.580966 5112 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f5051b3-19d4-422e-a8d1-47129e287d57-ca-trust-extracted\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:14.580992 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.580987 5112 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-bound-sa-token\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:14.581107 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.581002 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpvhk\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-kube-api-access-gpvhk\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:14.581107 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.581013 5112 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-installation-pull-secrets\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:14.581107 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.581022 5112 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f5051b3-19d4-422e-a8d1-47129e287d57-registry-tls\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:14.581107 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:14.581030 5112 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f5051b3-19d4-422e-a8d1-47129e287d57-image-registry-private-configuration\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:15.252899 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:15.252865 5112 generic.go:356] "Generic (PLEG): container finished" podID="2f5051b3-19d4-422e-a8d1-47129e287d57" containerID="cad0dea6d92355a2bd2fcdfb368fcb8b36428aa4722e6194f384dc04cbc6ef3a" exitCode=0 Oct 30 23:36:15.253385 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:15.252914 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6749d98767-f4mjs" event={"ID":"2f5051b3-19d4-422e-a8d1-47129e287d57","Type":"ContainerDied","Data":"cad0dea6d92355a2bd2fcdfb368fcb8b36428aa4722e6194f384dc04cbc6ef3a"} Oct 30 23:36:15.253385 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:15.252924 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6749d98767-f4mjs" Oct 30 23:36:15.253385 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:15.252959 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6749d98767-f4mjs" event={"ID":"2f5051b3-19d4-422e-a8d1-47129e287d57","Type":"ContainerDied","Data":"185c770bd00687f85a94218231f162d2899721a88e4a914ed4c53e73e6c1cb01"} Oct 30 23:36:15.253385 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:15.252983 5112 scope.go:122] "RemoveContainer" containerID="cad0dea6d92355a2bd2fcdfb368fcb8b36428aa4722e6194f384dc04cbc6ef3a" Oct 30 23:36:15.262100 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:15.262077 5112 scope.go:122] "RemoveContainer" containerID="cad0dea6d92355a2bd2fcdfb368fcb8b36428aa4722e6194f384dc04cbc6ef3a" Oct 30 23:36:15.262392 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:36:15.262370 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad0dea6d92355a2bd2fcdfb368fcb8b36428aa4722e6194f384dc04cbc6ef3a\": container with ID starting with cad0dea6d92355a2bd2fcdfb368fcb8b36428aa4722e6194f384dc04cbc6ef3a not found: ID does not exist" containerID="cad0dea6d92355a2bd2fcdfb368fcb8b36428aa4722e6194f384dc04cbc6ef3a" Oct 30 23:36:15.262451 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:15.262405 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad0dea6d92355a2bd2fcdfb368fcb8b36428aa4722e6194f384dc04cbc6ef3a"} err="failed to get container status \"cad0dea6d92355a2bd2fcdfb368fcb8b36428aa4722e6194f384dc04cbc6ef3a\": rpc error: code = NotFound desc = could not find container \"cad0dea6d92355a2bd2fcdfb368fcb8b36428aa4722e6194f384dc04cbc6ef3a\": container with ID starting with cad0dea6d92355a2bd2fcdfb368fcb8b36428aa4722e6194f384dc04cbc6ef3a not found: ID does not exist" Oct 30 23:36:15.314714 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:15.314690 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6749d98767-f4mjs"] Oct 30 23:36:15.326107 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:15.326086 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6749d98767-f4mjs"] Oct 30 23:36:15.874891 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:15.874859 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2f5051b3-19d4-422e-a8d1-47129e287d57" path="/var/lib/kubelet/pods/2f5051b3-19d4-422e-a8d1-47129e287d57/volumes" Oct 30 23:36:22.974231 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:36:22.974194 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:36:27.308766 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:27.308729 5112 generic.go:356] "Generic (PLEG): container finished" podID="85f5885d-de4d-472f-aa8e-036454ea9a4d" containerID="c57b4e9b958bed8a58c50f99a711303964abb4914e05741bf20640eec879b3d6" exitCode=0 Oct 30 23:36:27.309220 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:27.308811 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" event={"ID":"85f5885d-de4d-472f-aa8e-036454ea9a4d","Type":"ContainerDied","Data":"c57b4e9b958bed8a58c50f99a711303964abb4914e05741bf20640eec879b3d6"} Oct 30 23:36:27.309220 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:27.309149 5112 scope.go:122] "RemoveContainer" containerID="c57b4e9b958bed8a58c50f99a711303964abb4914e05741bf20640eec879b3d6" Oct 30 23:36:28.315109 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:28.315066 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-7plns" event={"ID":"85f5885d-de4d-472f-aa8e-036454ea9a4d","Type":"ContainerStarted","Data":"ceaa68dd7ab5cc262cd91bbe9625a8ac87b17b109e9df700e2ec0c1c42d1964f"} Oct 30 23:36:41.369346 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:41.369274 5112 generic.go:356] "Generic (PLEG): container finished" podID="9cb59a65-5d33-4842-abe0-582372433b12" containerID="6eee7c7bd5cab58f7f5c76d3b07d33e689398b83596545da6a2477f7335179cd" exitCode=0 Oct 30 23:36:41.369807 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:41.369354 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-dwmwv" event={"ID":"9cb59a65-5d33-4842-abe0-582372433b12","Type":"ContainerDied","Data":"6eee7c7bd5cab58f7f5c76d3b07d33e689398b83596545da6a2477f7335179cd"} Oct 30 23:36:41.369807 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:41.369432 5112 scope.go:122] "RemoveContainer" containerID="7474a42d2f1e0565ef843f9465a74f4881106fa1216f64157b897f089966c3cf" Oct 30 23:36:41.369807 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:41.369741 5112 scope.go:122] "RemoveContainer" containerID="6eee7c7bd5cab58f7f5c76d3b07d33e689398b83596545da6a2477f7335179cd" Oct 30 23:36:41.369960 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:36:41.369939 5112 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"insights-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=insights-operator pod=insights-operator-7c4986d449-dwmwv_openshift-insights(9cb59a65-5d33-4842-abe0-582372433b12)\"" pod="openshift-insights/insights-operator-7c4986d449-dwmwv" podUID="9cb59a65-5d33-4842-abe0-582372433b12" Oct 30 23:36:52.352659 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:36:52.352632 5112 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod049ece3c_3f2f_47a8_a0f4_5f2904b66755.slice/crio-93d073df8e2ee21028a35073e584e1f9c38602808303099fbabbbbbcfcfcc2b0.scope\": RecentStats: unable to find data in memory cache]" Oct 30 23:36:52.414544 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:52.414519 5112 generic.go:356] "Generic (PLEG): container finished" podID="049ece3c-3f2f-47a8-a0f4-5f2904b66755" containerID="93d073df8e2ee21028a35073e584e1f9c38602808303099fbabbbbbcfcfcc2b0" exitCode=0 Oct 30 23:36:52.414658 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:52.414597 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" event={"ID":"049ece3c-3f2f-47a8-a0f4-5f2904b66755","Type":"ContainerDied","Data":"93d073df8e2ee21028a35073e584e1f9c38602808303099fbabbbbbcfcfcc2b0"} Oct 30 23:36:52.869567 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:52.869536 5112 scope.go:122] "RemoveContainer" containerID="6eee7c7bd5cab58f7f5c76d3b07d33e689398b83596545da6a2477f7335179cd" Oct 30 23:36:52.978753 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:36:52.978697 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:36:53.420632 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:53.420600 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-dwmwv" event={"ID":"9cb59a65-5d33-4842-abe0-582372433b12","Type":"ContainerStarted","Data":"8c3bb9e6486af92738332868464e8ecff48afd86c32e1e26cc072b118410e836"} Oct 30 23:36:53.473752 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:53.473479 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-nfsxz-6f4bq"] Oct 30 23:36:53.562064 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:53.562025 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:36:53.647811 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:53.647789 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/049ece3c-3f2f-47a8-a0f4-5f2904b66755-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/049ece3c-3f2f-47a8-a0f4-5f2904b66755-service-ca-bundle\") pod \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " Oct 30 23:36:53.647961 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:53.647840 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/049ece3c-3f2f-47a8-a0f4-5f2904b66755-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/049ece3c-3f2f-47a8-a0f4-5f2904b66755-archives-path\") pod \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " Oct 30 23:36:53.647961 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:53.647900 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/049ece3c-3f2f-47a8-a0f4-5f2904b66755-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/049ece3c-3f2f-47a8-a0f4-5f2904b66755-trusted-ca-bundle\") pod \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " Oct 30 23:36:53.647961 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:53.647924 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/049ece3c-3f2f-47a8-a0f4-5f2904b66755-kube-api-access-csscz\" (UniqueName: \"kubernetes.io/projected/049ece3c-3f2f-47a8-a0f4-5f2904b66755-kube-api-access-csscz\") pod \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\" (UID: \"049ece3c-3f2f-47a8-a0f4-5f2904b66755\") " Oct 30 23:36:53.648230 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:53.648205 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/049ece3c-3f2f-47a8-a0f4-5f2904b66755-archives-path" pod "049ece3c-3f2f-47a8-a0f4-5f2904b66755" (UID: "049ece3c-3f2f-47a8-a0f4-5f2904b66755"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:36:53.648280 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:53.648208 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/049ece3c-3f2f-47a8-a0f4-5f2904b66755-service-ca-bundle" pod "049ece3c-3f2f-47a8-a0f4-5f2904b66755" (UID: "049ece3c-3f2f-47a8-a0f4-5f2904b66755"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:36:53.648280 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:53.648247 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/049ece3c-3f2f-47a8-a0f4-5f2904b66755-trusted-ca-bundle" pod "049ece3c-3f2f-47a8-a0f4-5f2904b66755" (UID: "049ece3c-3f2f-47a8-a0f4-5f2904b66755"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:36:53.649869 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:53.649847 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/049ece3c-3f2f-47a8-a0f4-5f2904b66755-kube-api-access-csscz" pod "049ece3c-3f2f-47a8-a0f4-5f2904b66755" (UID: "049ece3c-3f2f-47a8-a0f4-5f2904b66755"). InnerVolumeSpecName "kube-api-access-csscz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:36:53.748694 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:53.748672 5112 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/049ece3c-3f2f-47a8-a0f4-5f2904b66755-trusted-ca-bundle\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:53.748796 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:53.748697 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csscz\" (UniqueName: \"kubernetes.io/projected/049ece3c-3f2f-47a8-a0f4-5f2904b66755-kube-api-access-csscz\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:53.748796 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:53.748711 5112 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/049ece3c-3f2f-47a8-a0f4-5f2904b66755-service-ca-bundle\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:53.748796 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:53.748724 5112 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/049ece3c-3f2f-47a8-a0f4-5f2904b66755-archives-path\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:36:54.425252 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:54.425212 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" event={"ID":"049ece3c-3f2f-47a8-a0f4-5f2904b66755","Type":"ContainerDied","Data":"13e8c4f3455356ce7144be122b272c7b15d9186f8b64bba707695479d283244d"} Oct 30 23:36:54.425620 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:54.425296 5112 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13e8c4f3455356ce7144be122b272c7b15d9186f8b64bba707695479d283244d" Oct 30 23:36:54.425620 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:54.425228 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-nfsxz-6f4bq" Oct 30 23:36:54.493439 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:54.493416 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-nfsxz-6f4bq"] Oct 30 23:36:54.495266 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:54.495245 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-nfsxz-6f4bq"] Oct 30 23:36:55.874437 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:36:55.874403 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="049ece3c-3f2f-47a8-a0f4-5f2904b66755" path="/var/lib/kubelet/pods/049ece3c-3f2f-47a8-a0f4-5f2904b66755/volumes" Oct 30 23:37:22.977964 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:37:22.977874 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:37:52.976370 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:37:52.976328 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:38:22.976223 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:38:22.976182 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:38:52.975971 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:38:52.975892 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:39:02.530676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:02.530639 5112 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" podUID="115f903faf6fce7f69241f9f5ad98f46" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded" Oct 30 23:39:22.975607 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:39:22.975568 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:39:46.911246 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.911211 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs"] Oct 30 23:39:46.913765 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.911592 5112 cpu_manager.go:414] "containerMap: removing container" podUID="2f5051b3-19d4-422e-a8d1-47129e287d57" containerName="registry" Oct 30 23:39:46.913765 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.911608 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f5051b3-19d4-422e-a8d1-47129e287d57" containerName="registry" Oct 30 23:39:46.913765 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.911621 5112 cpu_manager.go:414] "containerMap: removing container" podUID="05a8da7c-7313-471b-8437-fff42cdbda65" containerName="registry" Oct 30 23:39:46.913765 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.911629 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05a8da7c-7313-471b-8437-fff42cdbda65" containerName="registry" Oct 30 23:39:46.913765 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.911642 5112 cpu_manager.go:414] "containerMap: removing container" podUID="3549b0b4-488b-4819-b37a-8a566c3d5514" containerName="insights-gathering" Oct 30 23:39:46.913765 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.911649 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3549b0b4-488b-4819-b37a-8a566c3d5514" containerName="insights-gathering" Oct 30 23:39:46.913765 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.911676 5112 cpu_manager.go:414] "containerMap: removing container" podUID="049ece3c-3f2f-47a8-a0f4-5f2904b66755" containerName="insights-gathering" Oct 30 23:39:46.913765 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.911683 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="049ece3c-3f2f-47a8-a0f4-5f2904b66755" containerName="insights-gathering" Oct 30 23:39:46.913765 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.911780 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f5051b3-19d4-422e-a8d1-47129e287d57" containerName="registry" Oct 30 23:39:46.913765 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.911791 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="05a8da7c-7313-471b-8437-fff42cdbda65" containerName="registry" Oct 30 23:39:46.913765 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.911798 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="3549b0b4-488b-4819-b37a-8a566c3d5514" containerName="insights-gathering" Oct 30 23:39:46.913765 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.911806 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="049ece3c-3f2f-47a8-a0f4-5f2904b66755" containerName="insights-gathering" Oct 30 23:39:46.914593 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.914577 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:46.935226 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.935204 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Oct 30 23:39:46.946415 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.946392 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-gqhxh\"" Oct 30 23:39:46.947522 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.947502 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs"] Oct 30 23:39:46.958089 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.958066 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:46.958206 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.958103 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn9gr\" (UniqueName: \"kubernetes.io/projected/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-kube-api-access-mn9gr\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:46.958206 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.958132 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:46.958327 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.958264 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:46.958327 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.958305 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:46.958435 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.958424 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:46.958489 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.958447 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:46.958489 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.958464 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:46.958589 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:46.958563 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.059018 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.058995 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.059125 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.059023 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.059125 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.059058 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.059125 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.059083 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.059125 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.059117 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.059314 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.059141 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn9gr\" (UniqueName: \"kubernetes.io/projected/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-kube-api-access-mn9gr\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.059314 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.059168 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.059314 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.059226 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.059314 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.059261 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.059507 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.059447 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.059728 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.059694 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.059837 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.059700 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.059837 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.059763 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.059926 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.059830 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.061349 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.061322 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.061562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.061544 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.078215 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.078194 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn9gr\" (UniqueName: \"kubernetes.io/projected/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-kube-api-access-mn9gr\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.078467 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.078446 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6f83d6-3d40-4d9f-8500-7a27b603bd77-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs\" (UID: \"3b6f83d6-3d40-4d9f-8500-7a27b603bd77\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.227955 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.227891 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:47.543651 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:47.543619 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs"] Oct 30 23:39:47.547900 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:39:47.547871 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6f83d6_3d40_4d9f_8500_7a27b603bd77.slice/crio-658b2e5d3a7a63eec38062ecde728ac365425feb9e5b2ed9211bebd17fda40b4 WatchSource:0}: Error finding container 658b2e5d3a7a63eec38062ecde728ac365425feb9e5b2ed9211bebd17fda40b4: Status 404 returned error can't find the container with id 658b2e5d3a7a63eec38062ecde728ac365425feb9e5b2ed9211bebd17fda40b4 Oct 30 23:39:48.155496 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:48.155462 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" event={"ID":"3b6f83d6-3d40-4d9f-8500-7a27b603bd77","Type":"ContainerStarted","Data":"658b2e5d3a7a63eec38062ecde728ac365425feb9e5b2ed9211bebd17fda40b4"} Oct 30 23:39:50.201715 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.201679 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n"] Oct 30 23:39:50.208769 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.208746 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" Oct 30 23:39:50.223263 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.223242 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n"] Oct 30 23:39:50.233928 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.233904 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-ctth7\"" Oct 30 23:39:50.234170 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.234143 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 30 23:39:50.234271 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.234262 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 30 23:39:50.234988 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.234959 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr"] Oct 30 23:39:50.238595 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.238577 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" Oct 30 23:39:50.252766 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.252715 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr"] Oct 30 23:39:50.263170 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.263150 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g"] Oct 30 23:39:50.266673 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.266654 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" Oct 30 23:39:50.281529 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.281503 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15a33c8e-c99f-4665-97d0-a549ca062417-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr\" (UID: \"15a33c8e-c99f-4665-97d0-a549ca062417\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" Oct 30 23:39:50.281609 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.281550 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgq7l\" (UniqueName: \"kubernetes.io/projected/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-kube-api-access-bgq7l\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g\" (UID: \"2001a6fd-b06a-4abb-a74c-5caf5e82ac54\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" Oct 30 23:39:50.281660 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.281629 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15a33c8e-c99f-4665-97d0-a549ca062417-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr\" (UID: \"15a33c8e-c99f-4665-97d0-a549ca062417\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" Oct 30 23:39:50.281708 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.281668 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g\" (UID: \"2001a6fd-b06a-4abb-a74c-5caf5e82ac54\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" Oct 30 23:39:50.281708 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.281695 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g\" (UID: \"2001a6fd-b06a-4abb-a74c-5caf5e82ac54\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" Oct 30 23:39:50.281811 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.281772 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8733858b-b88d-4ca5-882e-4f8b237152c0-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n\" (UID: \"8733858b-b88d-4ca5-882e-4f8b237152c0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" Oct 30 23:39:50.281847 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.281831 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n2gz\" (UniqueName: \"kubernetes.io/projected/15a33c8e-c99f-4665-97d0-a549ca062417-kube-api-access-9n2gz\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr\" (UID: \"15a33c8e-c99f-4665-97d0-a549ca062417\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" Oct 30 23:39:50.281879 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.281866 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8733858b-b88d-4ca5-882e-4f8b237152c0-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n\" (UID: \"8733858b-b88d-4ca5-882e-4f8b237152c0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" Oct 30 23:39:50.281914 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.281881 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlqgd\" (UniqueName: \"kubernetes.io/projected/8733858b-b88d-4ca5-882e-4f8b237152c0-kube-api-access-tlqgd\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n\" (UID: \"8733858b-b88d-4ca5-882e-4f8b237152c0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" Oct 30 23:39:50.285321 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.285299 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g"] Oct 30 23:39:50.299265 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.299238 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz"] Oct 30 23:39:50.308359 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.308337 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" Oct 30 23:39:50.321810 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.321780 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz"] Oct 30 23:39:50.324138 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.324118 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-4lp5v\"" Oct 30 23:39:50.324282 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.324265 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-7vcq4\"" Oct 30 23:39:50.324363 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.324295 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-vhtgn\"" Oct 30 23:39:50.382382 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.382357 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n2gz\" (UniqueName: \"kubernetes.io/projected/15a33c8e-c99f-4665-97d0-a549ca062417-kube-api-access-9n2gz\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr\" (UID: \"15a33c8e-c99f-4665-97d0-a549ca062417\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" Oct 30 23:39:50.382504 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.382409 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8733858b-b88d-4ca5-882e-4f8b237152c0-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n\" (UID: \"8733858b-b88d-4ca5-882e-4f8b237152c0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" Oct 30 23:39:50.382504 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.382432 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlqgd\" (UniqueName: \"kubernetes.io/projected/8733858b-b88d-4ca5-882e-4f8b237152c0-kube-api-access-tlqgd\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n\" (UID: \"8733858b-b88d-4ca5-882e-4f8b237152c0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" Oct 30 23:39:50.382504 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.382457 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/458d62ee-6dfb-4824-87d2-ca081c265d5d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz\" (UID: \"458d62ee-6dfb-4824-87d2-ca081c265d5d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" Oct 30 23:39:50.382504 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.382498 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15a33c8e-c99f-4665-97d0-a549ca062417-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr\" (UID: \"15a33c8e-c99f-4665-97d0-a549ca062417\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" Oct 30 23:39:50.382669 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.382557 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmv7z\" (UniqueName: \"kubernetes.io/projected/458d62ee-6dfb-4824-87d2-ca081c265d5d-kube-api-access-gmv7z\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz\" (UID: \"458d62ee-6dfb-4824-87d2-ca081c265d5d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" Oct 30 23:39:50.382757 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.382733 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/458d62ee-6dfb-4824-87d2-ca081c265d5d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz\" (UID: \"458d62ee-6dfb-4824-87d2-ca081c265d5d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" Oct 30 23:39:50.382826 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.382809 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgq7l\" (UniqueName: \"kubernetes.io/projected/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-kube-api-access-bgq7l\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g\" (UID: \"2001a6fd-b06a-4abb-a74c-5caf5e82ac54\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" Oct 30 23:39:50.382881 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.382854 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8733858b-b88d-4ca5-882e-4f8b237152c0-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n\" (UID: \"8733858b-b88d-4ca5-882e-4f8b237152c0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" Oct 30 23:39:50.382935 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.382887 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15a33c8e-c99f-4665-97d0-a549ca062417-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr\" (UID: \"15a33c8e-c99f-4665-97d0-a549ca062417\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" Oct 30 23:39:50.382988 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.382935 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g\" (UID: \"2001a6fd-b06a-4abb-a74c-5caf5e82ac54\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" Oct 30 23:39:50.382988 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.382960 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15a33c8e-c99f-4665-97d0-a549ca062417-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr\" (UID: \"15a33c8e-c99f-4665-97d0-a549ca062417\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" Oct 30 23:39:50.382988 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.382962 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g\" (UID: \"2001a6fd-b06a-4abb-a74c-5caf5e82ac54\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" Oct 30 23:39:50.383179 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.383002 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8733858b-b88d-4ca5-882e-4f8b237152c0-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n\" (UID: \"8733858b-b88d-4ca5-882e-4f8b237152c0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" Oct 30 23:39:50.383240 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.383211 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15a33c8e-c99f-4665-97d0-a549ca062417-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr\" (UID: \"15a33c8e-c99f-4665-97d0-a549ca062417\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" Oct 30 23:39:50.383348 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.383326 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8733858b-b88d-4ca5-882e-4f8b237152c0-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n\" (UID: \"8733858b-b88d-4ca5-882e-4f8b237152c0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" Oct 30 23:39:50.383402 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.383347 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g\" (UID: \"2001a6fd-b06a-4abb-a74c-5caf5e82ac54\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" Oct 30 23:39:50.383402 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.383357 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g\" (UID: \"2001a6fd-b06a-4abb-a74c-5caf5e82ac54\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" Oct 30 23:39:50.403106 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.403085 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlqgd\" (UniqueName: \"kubernetes.io/projected/8733858b-b88d-4ca5-882e-4f8b237152c0-kube-api-access-tlqgd\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n\" (UID: \"8733858b-b88d-4ca5-882e-4f8b237152c0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" Oct 30 23:39:50.403234 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.403212 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgq7l\" (UniqueName: \"kubernetes.io/projected/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-kube-api-access-bgq7l\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g\" (UID: \"2001a6fd-b06a-4abb-a74c-5caf5e82ac54\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" Oct 30 23:39:50.403303 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.403213 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n2gz\" (UniqueName: \"kubernetes.io/projected/15a33c8e-c99f-4665-97d0-a549ca062417-kube-api-access-9n2gz\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr\" (UID: \"15a33c8e-c99f-4665-97d0-a549ca062417\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" Oct 30 23:39:50.484031 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.484005 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/458d62ee-6dfb-4824-87d2-ca081c265d5d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz\" (UID: \"458d62ee-6dfb-4824-87d2-ca081c265d5d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" Oct 30 23:39:50.484175 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.484084 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmv7z\" (UniqueName: \"kubernetes.io/projected/458d62ee-6dfb-4824-87d2-ca081c265d5d-kube-api-access-gmv7z\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz\" (UID: \"458d62ee-6dfb-4824-87d2-ca081c265d5d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" Oct 30 23:39:50.484175 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.484127 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/458d62ee-6dfb-4824-87d2-ca081c265d5d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz\" (UID: \"458d62ee-6dfb-4824-87d2-ca081c265d5d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" Oct 30 23:39:50.484364 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.484340 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/458d62ee-6dfb-4824-87d2-ca081c265d5d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz\" (UID: \"458d62ee-6dfb-4824-87d2-ca081c265d5d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" Oct 30 23:39:50.484432 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.484413 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/458d62ee-6dfb-4824-87d2-ca081c265d5d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz\" (UID: \"458d62ee-6dfb-4824-87d2-ca081c265d5d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" Oct 30 23:39:50.503755 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.503737 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmv7z\" (UniqueName: \"kubernetes.io/projected/458d62ee-6dfb-4824-87d2-ca081c265d5d-kube-api-access-gmv7z\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz\" (UID: \"458d62ee-6dfb-4824-87d2-ca081c265d5d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" Oct 30 23:39:50.528369 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.528343 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" Oct 30 23:39:50.555247 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.555222 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:39:50.555344 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.555281 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:39:50.555344 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.555313 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:39:50.557172 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.557151 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" Oct 30 23:39:50.584077 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.583871 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" Oct 30 23:39:50.628760 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.628737 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" Oct 30 23:39:50.865906 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.865790 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n"] Oct 30 23:39:50.868613 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.868595 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr"] Oct 30 23:39:50.870248 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:39:50.870220 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8733858b_b88d_4ca5_882e_4f8b237152c0.slice/crio-0baa178782dcfb99589216d74209986bd266c012a59b8669e88dff7c0d9be40b WatchSource:0}: Error finding container 0baa178782dcfb99589216d74209986bd266c012a59b8669e88dff7c0d9be40b: Status 404 returned error can't find the container with id 0baa178782dcfb99589216d74209986bd266c012a59b8669e88dff7c0d9be40b Oct 30 23:39:50.875888 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:39:50.875865 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a33c8e_c99f_4665_97d0_a549ca062417.slice/crio-de10b9f9e2f99d5179fc5ec4fc992c2ecf51018a4bf0e6c358cc693a39873471 WatchSource:0}: Error finding container de10b9f9e2f99d5179fc5ec4fc992c2ecf51018a4bf0e6c358cc693a39873471: Status 404 returned error can't find the container with id de10b9f9e2f99d5179fc5ec4fc992c2ecf51018a4bf0e6c358cc693a39873471 Oct 30 23:39:50.921261 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.921237 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g"] Oct 30 23:39:50.926121 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:39:50.926098 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2001a6fd_b06a_4abb_a74c_5caf5e82ac54.slice/crio-7bb95572a0a7c86a98a40c7fb7194d0fe10d152d86f5a3ac0c0d2f7781c1fa9f WatchSource:0}: Error finding container 7bb95572a0a7c86a98a40c7fb7194d0fe10d152d86f5a3ac0c0d2f7781c1fa9f: Status 404 returned error can't find the container with id 7bb95572a0a7c86a98a40c7fb7194d0fe10d152d86f5a3ac0c0d2f7781c1fa9f Oct 30 23:39:50.950418 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:50.950393 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz"] Oct 30 23:39:50.954498 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:39:50.954477 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458d62ee_6dfb_4824_87d2_ca081c265d5d.slice/crio-f6eee6304122c29196f87711820ed8736e6bead536699a7aeec736fca42e0e58 WatchSource:0}: Error finding container f6eee6304122c29196f87711820ed8736e6bead536699a7aeec736fca42e0e58: Status 404 returned error can't find the container with id f6eee6304122c29196f87711820ed8736e6bead536699a7aeec736fca42e0e58 Oct 30 23:39:51.169944 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:51.169877 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" event={"ID":"2001a6fd-b06a-4abb-a74c-5caf5e82ac54","Type":"ContainerStarted","Data":"7bb95572a0a7c86a98a40c7fb7194d0fe10d152d86f5a3ac0c0d2f7781c1fa9f"} Oct 30 23:39:51.170999 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:51.170978 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" event={"ID":"8733858b-b88d-4ca5-882e-4f8b237152c0","Type":"ContainerStarted","Data":"0baa178782dcfb99589216d74209986bd266c012a59b8669e88dff7c0d9be40b"} Oct 30 23:39:51.172533 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:51.172512 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" event={"ID":"3b6f83d6-3d40-4d9f-8500-7a27b603bd77","Type":"ContainerStarted","Data":"2da0f91eb91976661b203de45b166ac6b9a6b1660ce71fd96c9011b7273657ae"} Oct 30 23:39:51.173664 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:51.173644 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" event={"ID":"458d62ee-6dfb-4824-87d2-ca081c265d5d","Type":"ContainerStarted","Data":"f6eee6304122c29196f87711820ed8736e6bead536699a7aeec736fca42e0e58"} Oct 30 23:39:51.174652 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:51.174633 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" event={"ID":"15a33c8e-c99f-4665-97d0-a549ca062417","Type":"ContainerStarted","Data":"de10b9f9e2f99d5179fc5ec4fc992c2ecf51018a4bf0e6c358cc693a39873471"} Oct 30 23:39:51.220659 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:51.220616 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" podStartSLOduration=2.216002725 podStartE2EDuration="5.220600389s" totalImagesPullingTime="3.004597664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:39:51.219383429 +0000 UTC m=+279.483289001" watchObservedRunningTime="2026-10-30 23:39:51.220600389 +0000 UTC m=+279.484505963" Oct 30 23:39:51.228185 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:51.228164 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:51.233088 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:51.233069 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:52.184564 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:52.184534 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:52.185633 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:39:52.185590 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs" Oct 30 23:39:52.998354 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:39:52.997446 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:40:00.234189 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:00.234107 5112 generic.go:356] "Generic (PLEG): container finished" podID="458d62ee-6dfb-4824-87d2-ca081c265d5d" containerID="eda04c90effb89d642aca2822d8b5fdf909beffc97a750a4211bca3a0b0c742c" exitCode=0 Oct 30 23:40:00.234611 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:00.234206 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" event={"ID":"458d62ee-6dfb-4824-87d2-ca081c265d5d","Type":"ContainerDied","Data":"eda04c90effb89d642aca2822d8b5fdf909beffc97a750a4211bca3a0b0c742c"} Oct 30 23:40:00.236011 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:00.235978 5112 generic.go:356] "Generic (PLEG): container finished" podID="15a33c8e-c99f-4665-97d0-a549ca062417" containerID="a48f1eaa0f5a4276b072192818e13578d2fefbc758e30d221356e344dbd652eb" exitCode=0 Oct 30 23:40:00.236154 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:00.236077 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" event={"ID":"15a33c8e-c99f-4665-97d0-a549ca062417","Type":"ContainerDied","Data":"a48f1eaa0f5a4276b072192818e13578d2fefbc758e30d221356e344dbd652eb"} Oct 30 23:40:00.237862 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:00.237815 5112 generic.go:356] "Generic (PLEG): container finished" podID="2001a6fd-b06a-4abb-a74c-5caf5e82ac54" containerID="43400dcf0904776b043d3e61d3179f231d259b8f4ecf203f69ef03677e127d08" exitCode=0 Oct 30 23:40:00.237923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:00.237886 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" event={"ID":"2001a6fd-b06a-4abb-a74c-5caf5e82ac54","Type":"ContainerDied","Data":"43400dcf0904776b043d3e61d3179f231d259b8f4ecf203f69ef03677e127d08"} Oct 30 23:40:00.239779 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:00.239758 5112 generic.go:356] "Generic (PLEG): container finished" podID="8733858b-b88d-4ca5-882e-4f8b237152c0" containerID="dfd6b5029f3f639cd929b190107090a9d2f2f421f3adcf7f6dcb94504cd92fe6" exitCode=0 Oct 30 23:40:00.239853 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:00.239831 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" event={"ID":"8733858b-b88d-4ca5-882e-4f8b237152c0","Type":"ContainerDied","Data":"dfd6b5029f3f639cd929b190107090a9d2f2f421f3adcf7f6dcb94504cd92fe6"} Oct 30 23:40:01.245808 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:01.245749 5112 generic.go:356] "Generic (PLEG): container finished" podID="15a33c8e-c99f-4665-97d0-a549ca062417" containerID="55c2ee92569fb5ca5a1e6a0ec27a7b593ab989d39c0c3c3a0dfc5241bc694c81" exitCode=0 Oct 30 23:40:01.246193 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:01.245838 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" event={"ID":"15a33c8e-c99f-4665-97d0-a549ca062417","Type":"ContainerDied","Data":"55c2ee92569fb5ca5a1e6a0ec27a7b593ab989d39c0c3c3a0dfc5241bc694c81"} Oct 30 23:40:01.250173 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:01.249518 5112 generic.go:356] "Generic (PLEG): container finished" podID="2001a6fd-b06a-4abb-a74c-5caf5e82ac54" containerID="78c80f8753c9c7a1e9dad44fef47b979b09776e999613d4716f6984681046aa5" exitCode=0 Oct 30 23:40:01.250173 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:01.249599 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" event={"ID":"2001a6fd-b06a-4abb-a74c-5caf5e82ac54","Type":"ContainerDied","Data":"78c80f8753c9c7a1e9dad44fef47b979b09776e999613d4716f6984681046aa5"} Oct 30 23:40:01.253375 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:01.253349 5112 generic.go:356] "Generic (PLEG): container finished" podID="8733858b-b88d-4ca5-882e-4f8b237152c0" containerID="1b2c0a82ad6d6ad9d5ff09de1e074c968dc94f76a803a11123bd48f041af3d15" exitCode=0 Oct 30 23:40:01.253468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:01.253435 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" event={"ID":"8733858b-b88d-4ca5-882e-4f8b237152c0","Type":"ContainerDied","Data":"1b2c0a82ad6d6ad9d5ff09de1e074c968dc94f76a803a11123bd48f041af3d15"} Oct 30 23:40:01.256166 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:01.256145 5112 generic.go:356] "Generic (PLEG): container finished" podID="458d62ee-6dfb-4824-87d2-ca081c265d5d" containerID="6721ac2111806760d88aabbde7ce4ef18bfd9da05a2d9d4970b082bf24a7f43e" exitCode=0 Oct 30 23:40:01.256279 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:01.256179 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" event={"ID":"458d62ee-6dfb-4824-87d2-ca081c265d5d","Type":"ContainerDied","Data":"6721ac2111806760d88aabbde7ce4ef18bfd9da05a2d9d4970b082bf24a7f43e"} Oct 30 23:40:11.323748 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:11.323678 5112 generic.go:356] "Generic (PLEG): container finished" podID="458d62ee-6dfb-4824-87d2-ca081c265d5d" containerID="9fd9c4ba56bdd5060f22b4b53b319ee2d69234c0fbd7d8f8fca8c50be8f88940" exitCode=0 Oct 30 23:40:11.324144 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:11.323755 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" event={"ID":"458d62ee-6dfb-4824-87d2-ca081c265d5d","Type":"ContainerDied","Data":"9fd9c4ba56bdd5060f22b4b53b319ee2d69234c0fbd7d8f8fca8c50be8f88940"} Oct 30 23:40:11.325877 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:11.325849 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" event={"ID":"15a33c8e-c99f-4665-97d0-a549ca062417","Type":"ContainerStarted","Data":"1e221c97adffdc2b171d057c6c17354693140fa2ba1a26ab9dc29d9915805407"} Oct 30 23:40:11.327823 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:11.327800 5112 generic.go:356] "Generic (PLEG): container finished" podID="2001a6fd-b06a-4abb-a74c-5caf5e82ac54" containerID="1404e07974a18979db2b341ac8a1072230b75b04917580fbce40fff9d061f48b" exitCode=0 Oct 30 23:40:11.327948 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:11.327878 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" event={"ID":"2001a6fd-b06a-4abb-a74c-5caf5e82ac54","Type":"ContainerDied","Data":"1404e07974a18979db2b341ac8a1072230b75b04917580fbce40fff9d061f48b"} Oct 30 23:40:11.330018 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:11.329995 5112 generic.go:356] "Generic (PLEG): container finished" podID="8733858b-b88d-4ca5-882e-4f8b237152c0" containerID="8a030cd1ab555184e632f389a2a371da7f1e5eba08e79be470cbec6f27c132cd" exitCode=0 Oct 30 23:40:11.330127 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:11.330032 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" event={"ID":"8733858b-b88d-4ca5-882e-4f8b237152c0","Type":"ContainerDied","Data":"8a030cd1ab555184e632f389a2a371da7f1e5eba08e79be470cbec6f27c132cd"} Oct 30 23:40:11.470710 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:11.470670 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" podStartSLOduration=2.425274722 podStartE2EDuration="21.470660457s" totalImagesPullingTime="19.045385735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:39:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:11.469774603 +0000 UTC m=+299.733680178" watchObservedRunningTime="2026-10-30 23:40:11.470660457 +0000 UTC m=+299.734566029" Oct 30 23:40:11.912281 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:11.912257 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/2.log" Oct 30 23:40:11.913148 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:11.913130 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/2.log" Oct 30 23:40:12.336074 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.335998 5112 generic.go:356] "Generic (PLEG): container finished" podID="15a33c8e-c99f-4665-97d0-a549ca062417" containerID="1e221c97adffdc2b171d057c6c17354693140fa2ba1a26ab9dc29d9915805407" exitCode=0 Oct 30 23:40:12.336381 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.336073 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" event={"ID":"15a33c8e-c99f-4665-97d0-a549ca062417","Type":"ContainerDied","Data":"1e221c97adffdc2b171d057c6c17354693140fa2ba1a26ab9dc29d9915805407"} Oct 30 23:40:12.496290 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.496266 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" Oct 30 23:40:12.500586 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.500567 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" Oct 30 23:40:12.515254 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.515237 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" Oct 30 23:40:12.588517 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.588435 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8733858b-b88d-4ca5-882e-4f8b237152c0-kube-api-access-tlqgd\" (UniqueName: \"kubernetes.io/projected/8733858b-b88d-4ca5-882e-4f8b237152c0-kube-api-access-tlqgd\") pod \"8733858b-b88d-4ca5-882e-4f8b237152c0\" (UID: \"8733858b-b88d-4ca5-882e-4f8b237152c0\") " Oct 30 23:40:12.588517 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.588502 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8733858b-b88d-4ca5-882e-4f8b237152c0-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8733858b-b88d-4ca5-882e-4f8b237152c0-bundle\") pod \"8733858b-b88d-4ca5-882e-4f8b237152c0\" (UID: \"8733858b-b88d-4ca5-882e-4f8b237152c0\") " Oct 30 23:40:12.588709 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.588599 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-util\" (UniqueName: \"kubernetes.io/empty-dir/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-util\") pod \"2001a6fd-b06a-4abb-a74c-5caf5e82ac54\" (UID: \"2001a6fd-b06a-4abb-a74c-5caf5e82ac54\") " Oct 30 23:40:12.588709 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.588651 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8733858b-b88d-4ca5-882e-4f8b237152c0-util\" (UniqueName: \"kubernetes.io/empty-dir/8733858b-b88d-4ca5-882e-4f8b237152c0-util\") pod \"8733858b-b88d-4ca5-882e-4f8b237152c0\" (UID: \"8733858b-b88d-4ca5-882e-4f8b237152c0\") " Oct 30 23:40:12.588819 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.588707 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/458d62ee-6dfb-4824-87d2-ca081c265d5d-util\" (UniqueName: \"kubernetes.io/empty-dir/458d62ee-6dfb-4824-87d2-ca081c265d5d-util\") pod \"458d62ee-6dfb-4824-87d2-ca081c265d5d\" (UID: \"458d62ee-6dfb-4824-87d2-ca081c265d5d\") " Oct 30 23:40:12.588819 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.588743 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-kube-api-access-bgq7l\" (UniqueName: \"kubernetes.io/projected/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-kube-api-access-bgq7l\") pod \"2001a6fd-b06a-4abb-a74c-5caf5e82ac54\" (UID: \"2001a6fd-b06a-4abb-a74c-5caf5e82ac54\") " Oct 30 23:40:12.588819 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.588778 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/458d62ee-6dfb-4824-87d2-ca081c265d5d-bundle\" (UniqueName: \"kubernetes.io/empty-dir/458d62ee-6dfb-4824-87d2-ca081c265d5d-bundle\") pod \"458d62ee-6dfb-4824-87d2-ca081c265d5d\" (UID: \"458d62ee-6dfb-4824-87d2-ca081c265d5d\") " Oct 30 23:40:12.588970 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.588818 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-bundle\" (UniqueName: \"kubernetes.io/empty-dir/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-bundle\") pod \"2001a6fd-b06a-4abb-a74c-5caf5e82ac54\" (UID: \"2001a6fd-b06a-4abb-a74c-5caf5e82ac54\") " Oct 30 23:40:12.588970 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.588867 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/458d62ee-6dfb-4824-87d2-ca081c265d5d-kube-api-access-gmv7z\" (UniqueName: \"kubernetes.io/projected/458d62ee-6dfb-4824-87d2-ca081c265d5d-kube-api-access-gmv7z\") pod \"458d62ee-6dfb-4824-87d2-ca081c265d5d\" (UID: \"458d62ee-6dfb-4824-87d2-ca081c265d5d\") " Oct 30 23:40:12.589445 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.589415 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8733858b-b88d-4ca5-882e-4f8b237152c0-bundle" pod "8733858b-b88d-4ca5-882e-4f8b237152c0" (UID: "8733858b-b88d-4ca5-882e-4f8b237152c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:40:12.590116 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.590088 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/458d62ee-6dfb-4824-87d2-ca081c265d5d-bundle" pod "458d62ee-6dfb-4824-87d2-ca081c265d5d" (UID: "458d62ee-6dfb-4824-87d2-ca081c265d5d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:40:12.590353 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.590322 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-bundle" pod "2001a6fd-b06a-4abb-a74c-5caf5e82ac54" (UID: "2001a6fd-b06a-4abb-a74c-5caf5e82ac54"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:40:12.591154 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.591131 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8733858b-b88d-4ca5-882e-4f8b237152c0-kube-api-access-tlqgd" pod "8733858b-b88d-4ca5-882e-4f8b237152c0" (UID: "8733858b-b88d-4ca5-882e-4f8b237152c0"). InnerVolumeSpecName "kube-api-access-tlqgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:40:12.591303 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.591273 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-kube-api-access-bgq7l" pod "2001a6fd-b06a-4abb-a74c-5caf5e82ac54" (UID: "2001a6fd-b06a-4abb-a74c-5caf5e82ac54"). InnerVolumeSpecName "kube-api-access-bgq7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:40:12.591427 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.591405 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/458d62ee-6dfb-4824-87d2-ca081c265d5d-kube-api-access-gmv7z" pod "458d62ee-6dfb-4824-87d2-ca081c265d5d" (UID: "458d62ee-6dfb-4824-87d2-ca081c265d5d"). InnerVolumeSpecName "kube-api-access-gmv7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:40:12.595161 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.595132 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8733858b-b88d-4ca5-882e-4f8b237152c0-util" pod "8733858b-b88d-4ca5-882e-4f8b237152c0" (UID: "8733858b-b88d-4ca5-882e-4f8b237152c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:40:12.595482 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.595460 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-util" pod "2001a6fd-b06a-4abb-a74c-5caf5e82ac54" (UID: "2001a6fd-b06a-4abb-a74c-5caf5e82ac54"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:40:12.596205 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.596176 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/458d62ee-6dfb-4824-87d2-ca081c265d5d-util" pod "458d62ee-6dfb-4824-87d2-ca081c265d5d" (UID: "458d62ee-6dfb-4824-87d2-ca081c265d5d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:40:12.689900 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.689874 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgq7l\" (UniqueName: \"kubernetes.io/projected/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-kube-api-access-bgq7l\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:40:12.689900 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.689897 5112 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/458d62ee-6dfb-4824-87d2-ca081c265d5d-bundle\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:40:12.690022 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.689908 5112 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-bundle\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:40:12.690022 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.689916 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmv7z\" (UniqueName: \"kubernetes.io/projected/458d62ee-6dfb-4824-87d2-ca081c265d5d-kube-api-access-gmv7z\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:40:12.690022 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.689925 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlqgd\" (UniqueName: \"kubernetes.io/projected/8733858b-b88d-4ca5-882e-4f8b237152c0-kube-api-access-tlqgd\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:40:12.690022 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.689933 5112 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8733858b-b88d-4ca5-882e-4f8b237152c0-bundle\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:40:12.690022 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.689941 5112 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2001a6fd-b06a-4abb-a74c-5caf5e82ac54-util\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:40:12.690022 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.689949 5112 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8733858b-b88d-4ca5-882e-4f8b237152c0-util\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:40:12.690022 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:12.689956 5112 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/458d62ee-6dfb-4824-87d2-ca081c265d5d-util\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:40:13.350212 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.350161 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" event={"ID":"2001a6fd-b06a-4abb-a74c-5caf5e82ac54","Type":"ContainerDied","Data":"7bb95572a0a7c86a98a40c7fb7194d0fe10d152d86f5a3ac0c0d2f7781c1fa9f"} Oct 30 23:40:13.350725 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.350252 5112 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bb95572a0a7c86a98a40c7fb7194d0fe10d152d86f5a3ac0c0d2f7781c1fa9f" Oct 30 23:40:13.350725 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.350181 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77865g" Oct 30 23:40:13.352628 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.352600 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" event={"ID":"8733858b-b88d-4ca5-882e-4f8b237152c0","Type":"ContainerDied","Data":"0baa178782dcfb99589216d74209986bd266c012a59b8669e88dff7c0d9be40b"} Oct 30 23:40:13.352628 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.352620 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7bz6n" Oct 30 23:40:13.352807 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.352648 5112 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0baa178782dcfb99589216d74209986bd266c012a59b8669e88dff7c0d9be40b" Oct 30 23:40:13.354936 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.354913 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" Oct 30 23:40:13.355057 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.354934 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68bkzz" event={"ID":"458d62ee-6dfb-4824-87d2-ca081c265d5d","Type":"ContainerDied","Data":"f6eee6304122c29196f87711820ed8736e6bead536699a7aeec736fca42e0e58"} Oct 30 23:40:13.355057 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.354983 5112 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6eee6304122c29196f87711820ed8736e6bead536699a7aeec736fca42e0e58" Oct 30 23:40:13.482952 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.482931 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" Oct 30 23:40:13.597516 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.597492 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15a33c8e-c99f-4665-97d0-a549ca062417-bundle\" (UniqueName: \"kubernetes.io/empty-dir/15a33c8e-c99f-4665-97d0-a549ca062417-bundle\") pod \"15a33c8e-c99f-4665-97d0-a549ca062417\" (UID: \"15a33c8e-c99f-4665-97d0-a549ca062417\") " Oct 30 23:40:13.597672 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.597542 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15a33c8e-c99f-4665-97d0-a549ca062417-kube-api-access-9n2gz\" (UniqueName: \"kubernetes.io/projected/15a33c8e-c99f-4665-97d0-a549ca062417-kube-api-access-9n2gz\") pod \"15a33c8e-c99f-4665-97d0-a549ca062417\" (UID: \"15a33c8e-c99f-4665-97d0-a549ca062417\") " Oct 30 23:40:13.597672 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.597565 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15a33c8e-c99f-4665-97d0-a549ca062417-util\" (UniqueName: \"kubernetes.io/empty-dir/15a33c8e-c99f-4665-97d0-a549ca062417-util\") pod \"15a33c8e-c99f-4665-97d0-a549ca062417\" (UID: \"15a33c8e-c99f-4665-97d0-a549ca062417\") " Oct 30 23:40:13.598011 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.597988 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15a33c8e-c99f-4665-97d0-a549ca062417-bundle" pod "15a33c8e-c99f-4665-97d0-a549ca062417" (UID: "15a33c8e-c99f-4665-97d0-a549ca062417"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:40:13.599607 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.599586 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15a33c8e-c99f-4665-97d0-a549ca062417-kube-api-access-9n2gz" pod "15a33c8e-c99f-4665-97d0-a549ca062417" (UID: "15a33c8e-c99f-4665-97d0-a549ca062417"). InnerVolumeSpecName "kube-api-access-9n2gz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:40:13.602967 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.602926 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15a33c8e-c99f-4665-97d0-a549ca062417-util" pod "15a33c8e-c99f-4665-97d0-a549ca062417" (UID: "15a33c8e-c99f-4665-97d0-a549ca062417"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:40:13.698007 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.697982 5112 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15a33c8e-c99f-4665-97d0-a549ca062417-bundle\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:40:13.698007 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.698003 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n2gz\" (UniqueName: \"kubernetes.io/projected/15a33c8e-c99f-4665-97d0-a549ca062417-kube-api-access-9n2gz\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:40:13.698146 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:13.698013 5112 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15a33c8e-c99f-4665-97d0-a549ca062417-util\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:40:14.362986 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:14.362964 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" Oct 30 23:40:14.362986 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:14.362968 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cb8kfr" event={"ID":"15a33c8e-c99f-4665-97d0-a549ca062417","Type":"ContainerDied","Data":"de10b9f9e2f99d5179fc5ec4fc992c2ecf51018a4bf0e6c358cc693a39873471"} Oct 30 23:40:14.363429 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:14.363020 5112 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de10b9f9e2f99d5179fc5ec4fc992c2ecf51018a4bf0e6c358cc693a39873471" Oct 30 23:40:22.973719 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:40:22.973634 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:40:29.365739 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.365707 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-s6vkp"] Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366014 5112 cpu_manager.go:414] "containerMap: removing container" podUID="15a33c8e-c99f-4665-97d0-a549ca062417" containerName="util" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366026 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15a33c8e-c99f-4665-97d0-a549ca062417" containerName="util" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366050 5112 cpu_manager.go:414] "containerMap: removing container" podUID="8733858b-b88d-4ca5-882e-4f8b237152c0" containerName="pull" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366059 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8733858b-b88d-4ca5-882e-4f8b237152c0" containerName="pull" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366078 5112 cpu_manager.go:414] "containerMap: removing container" podUID="2001a6fd-b06a-4abb-a74c-5caf5e82ac54" containerName="pull" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366085 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2001a6fd-b06a-4abb-a74c-5caf5e82ac54" containerName="pull" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366093 5112 cpu_manager.go:414] "containerMap: removing container" podUID="8733858b-b88d-4ca5-882e-4f8b237152c0" containerName="extract" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366097 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8733858b-b88d-4ca5-882e-4f8b237152c0" containerName="extract" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366106 5112 cpu_manager.go:414] "containerMap: removing container" podUID="458d62ee-6dfb-4824-87d2-ca081c265d5d" containerName="util" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366111 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="458d62ee-6dfb-4824-87d2-ca081c265d5d" containerName="util" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366117 5112 cpu_manager.go:414] "containerMap: removing container" podUID="15a33c8e-c99f-4665-97d0-a549ca062417" containerName="pull" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366121 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15a33c8e-c99f-4665-97d0-a549ca062417" containerName="pull" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366130 5112 cpu_manager.go:414] "containerMap: removing container" podUID="2001a6fd-b06a-4abb-a74c-5caf5e82ac54" containerName="extract" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366134 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2001a6fd-b06a-4abb-a74c-5caf5e82ac54" containerName="extract" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366140 5112 cpu_manager.go:414] "containerMap: removing container" podUID="15a33c8e-c99f-4665-97d0-a549ca062417" containerName="extract" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366146 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15a33c8e-c99f-4665-97d0-a549ca062417" containerName="extract" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366158 5112 cpu_manager.go:414] "containerMap: removing container" podUID="458d62ee-6dfb-4824-87d2-ca081c265d5d" containerName="extract" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366163 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="458d62ee-6dfb-4824-87d2-ca081c265d5d" containerName="extract" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366171 5112 cpu_manager.go:414] "containerMap: removing container" podUID="2001a6fd-b06a-4abb-a74c-5caf5e82ac54" containerName="util" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366176 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2001a6fd-b06a-4abb-a74c-5caf5e82ac54" containerName="util" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366183 5112 cpu_manager.go:414] "containerMap: removing container" podUID="8733858b-b88d-4ca5-882e-4f8b237152c0" containerName="util" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366187 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8733858b-b88d-4ca5-882e-4f8b237152c0" containerName="util" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366198 5112 cpu_manager.go:414] "containerMap: removing container" podUID="458d62ee-6dfb-4824-87d2-ca081c265d5d" containerName="pull" Oct 30 23:40:29.366228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366205 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="458d62ee-6dfb-4824-87d2-ca081c265d5d" containerName="pull" Oct 30 23:40:29.367771 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366712 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="458d62ee-6dfb-4824-87d2-ca081c265d5d" containerName="extract" Oct 30 23:40:29.367771 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366765 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="8733858b-b88d-4ca5-882e-4f8b237152c0" containerName="extract" Oct 30 23:40:29.367771 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366779 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="2001a6fd-b06a-4abb-a74c-5caf5e82ac54" containerName="extract" Oct 30 23:40:29.367771 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.366787 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="15a33c8e-c99f-4665-97d0-a549ca062417" containerName="extract" Oct 30 23:40:29.369839 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.369823 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-s6vkp" Oct 30 23:40:29.394790 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.394765 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Oct 30 23:40:29.394790 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.394772 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Oct 30 23:40:29.394971 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.394864 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-trr69\"" Oct 30 23:40:29.396283 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.396262 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-s6vkp"] Oct 30 23:40:29.507677 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.507647 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8xn6\" (UniqueName: \"kubernetes.io/projected/fe5c4410-bd12-4879-be81-48d0653a489d-kube-api-access-s8xn6\") pod \"authorino-operator-7b7bb4bc77-s6vkp\" (UID: \"fe5c4410-bd12-4879-be81-48d0653a489d\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-s6vkp" Oct 30 23:40:29.608184 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.608158 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8xn6\" (UniqueName: \"kubernetes.io/projected/fe5c4410-bd12-4879-be81-48d0653a489d-kube-api-access-s8xn6\") pod \"authorino-operator-7b7bb4bc77-s6vkp\" (UID: \"fe5c4410-bd12-4879-be81-48d0653a489d\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-s6vkp" Oct 30 23:40:29.635220 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.635160 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8xn6\" (UniqueName: \"kubernetes.io/projected/fe5c4410-bd12-4879-be81-48d0653a489d-kube-api-access-s8xn6\") pod \"authorino-operator-7b7bb4bc77-s6vkp\" (UID: \"fe5c4410-bd12-4879-be81-48d0653a489d\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-s6vkp" Oct 30 23:40:29.682076 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.682050 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-s6vkp" Oct 30 23:40:29.984470 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.984401 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-s6vkp"] Oct 30 23:40:29.989580 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:40:29.989554 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe5c4410_bd12_4879_be81_48d0653a489d.slice/crio-1d476983ca3c12ad0d542233584d88508327bd8b6856a0b2985790bff9875511 WatchSource:0}: Error finding container 1d476983ca3c12ad0d542233584d88508327bd8b6856a0b2985790bff9875511: Status 404 returned error can't find the container with id 1d476983ca3c12ad0d542233584d88508327bd8b6856a0b2985790bff9875511 Oct 30 23:40:29.991644 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:29.991623 5112 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 23:40:30.436219 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:30.436187 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-s6vkp" event={"ID":"fe5c4410-bd12-4879-be81-48d0653a489d","Type":"ContainerStarted","Data":"1d476983ca3c12ad0d542233584d88508327bd8b6856a0b2985790bff9875511"} Oct 30 23:40:32.447894 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:32.447870 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-s6vkp" event={"ID":"fe5c4410-bd12-4879-be81-48d0653a489d","Type":"ContainerStarted","Data":"51b953ed571b3dd963772e0ae5782fa341ae53c249f2835bc52181191808a8e1"} Oct 30 23:40:32.448231 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:32.448004 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-s6vkp" Oct 30 23:40:32.496874 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:32.496830 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-s6vkp" podStartSLOduration=1.119595732 podStartE2EDuration="3.496818122s" totalImagesPullingTime="2.37722239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:32.496189067 +0000 UTC m=+320.760094639" watchObservedRunningTime="2026-10-30 23:40:32.496818122 +0000 UTC m=+320.760723694" Oct 30 23:40:36.386999 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:36.386961 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds"] Oct 30 23:40:36.390582 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:36.390557 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" Oct 30 23:40:36.404243 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:36.404213 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds"] Oct 30 23:40:36.413881 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:36.413855 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tz4wc\"" Oct 30 23:40:36.456018 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:36.455996 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvq7m\" (UniqueName: \"kubernetes.io/projected/e5b55296-9cd2-49dc-bc59-53ac290439a1-kube-api-access-qvq7m\") pod \"kuadrant-operator-controller-manager-cf8469d7b-trkds\" (UID: \"e5b55296-9cd2-49dc-bc59-53ac290439a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" Oct 30 23:40:36.456119 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:36.456036 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5b55296-9cd2-49dc-bc59-53ac290439a1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-trkds\" (UID: \"e5b55296-9cd2-49dc-bc59-53ac290439a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" Oct 30 23:40:36.556658 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:36.556630 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvq7m\" (UniqueName: \"kubernetes.io/projected/e5b55296-9cd2-49dc-bc59-53ac290439a1-kube-api-access-qvq7m\") pod \"kuadrant-operator-controller-manager-cf8469d7b-trkds\" (UID: \"e5b55296-9cd2-49dc-bc59-53ac290439a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" Oct 30 23:40:36.556761 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:36.556690 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5b55296-9cd2-49dc-bc59-53ac290439a1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-trkds\" (UID: \"e5b55296-9cd2-49dc-bc59-53ac290439a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" Oct 30 23:40:36.557016 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:36.556996 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5b55296-9cd2-49dc-bc59-53ac290439a1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-trkds\" (UID: \"e5b55296-9cd2-49dc-bc59-53ac290439a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" Oct 30 23:40:36.582924 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:36.582896 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvq7m\" (UniqueName: \"kubernetes.io/projected/e5b55296-9cd2-49dc-bc59-53ac290439a1-kube-api-access-qvq7m\") pod \"kuadrant-operator-controller-manager-cf8469d7b-trkds\" (UID: \"e5b55296-9cd2-49dc-bc59-53ac290439a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" Oct 30 23:40:36.703657 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:36.703599 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" Oct 30 23:40:37.023399 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:37.023372 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds"] Oct 30 23:40:37.030033 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:40:37.030008 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b55296_9cd2_49dc_bc59_53ac290439a1.slice/crio-32b0a3b0eaba802f2dc915a0ff7f2928569ad6aff08f19e0f8bab4806c6753e3 WatchSource:0}: Error finding container 32b0a3b0eaba802f2dc915a0ff7f2928569ad6aff08f19e0f8bab4806c6753e3: Status 404 returned error can't find the container with id 32b0a3b0eaba802f2dc915a0ff7f2928569ad6aff08f19e0f8bab4806c6753e3 Oct 30 23:40:37.471399 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:37.471323 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" event={"ID":"e5b55296-9cd2-49dc-bc59-53ac290439a1","Type":"ContainerStarted","Data":"32b0a3b0eaba802f2dc915a0ff7f2928569ad6aff08f19e0f8bab4806c6753e3"} Oct 30 23:40:40.495457 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.495418 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc"] Oct 30 23:40:40.499493 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.499463 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.521612 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.521582 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Oct 30 23:40:40.530733 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.530704 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Oct 30 23:40:40.530733 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.530727 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Oct 30 23:40:40.530906 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.530758 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Oct 30 23:40:40.530906 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.530789 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-c6nt4\"" Oct 30 23:40:40.530906 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.530877 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Oct 30 23:40:40.540526 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.540487 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc"] Oct 30 23:40:40.599377 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.599353 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e79fb16-99e5-484f-b0a9-48986830b863-webhook-cert\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.599513 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.599392 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e79fb16-99e5-484f-b0a9-48986830b863-metrics-cert\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.599513 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.599494 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e79fb16-99e5-484f-b0a9-48986830b863-tmp\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.599622 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.599547 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e79fb16-99e5-484f-b0a9-48986830b863-apiservice-cert\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.599622 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.599611 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e79fb16-99e5-484f-b0a9-48986830b863-manifests\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.599724 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.599701 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7vc9\" (UniqueName: \"kubernetes.io/projected/1e79fb16-99e5-484f-b0a9-48986830b863-kube-api-access-j7vc9\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.700826 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.700793 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7vc9\" (UniqueName: \"kubernetes.io/projected/1e79fb16-99e5-484f-b0a9-48986830b863-kube-api-access-j7vc9\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.701009 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.700857 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e79fb16-99e5-484f-b0a9-48986830b863-webhook-cert\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.701009 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.700889 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e79fb16-99e5-484f-b0a9-48986830b863-metrics-cert\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.701009 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.700926 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e79fb16-99e5-484f-b0a9-48986830b863-tmp\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.701009 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.700968 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e79fb16-99e5-484f-b0a9-48986830b863-apiservice-cert\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.701009 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.701003 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e79fb16-99e5-484f-b0a9-48986830b863-manifests\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.701432 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.701410 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e79fb16-99e5-484f-b0a9-48986830b863-manifests\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.703919 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.703896 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e79fb16-99e5-484f-b0a9-48986830b863-tmp\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.704205 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.704172 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e79fb16-99e5-484f-b0a9-48986830b863-apiservice-cert\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.704314 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.704290 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e79fb16-99e5-484f-b0a9-48986830b863-webhook-cert\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.704314 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.704293 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e79fb16-99e5-484f-b0a9-48986830b863-metrics-cert\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.719486 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.719465 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7vc9\" (UniqueName: \"kubernetes.io/projected/1e79fb16-99e5-484f-b0a9-48986830b863-kube-api-access-j7vc9\") pod \"opendatahub-operator-controller-manager-776779f744-hbztc\" (UID: \"1e79fb16-99e5-484f-b0a9-48986830b863\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:40.816659 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:40.816638 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:41.195237 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:41.195168 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc"] Oct 30 23:40:41.211187 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:40:41.211162 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e79fb16_99e5_484f_b0a9_48986830b863.slice/crio-1fa9ca3f33161548091c2baadc3df25f90c65a191eddc138c11eb59f0a0eb033 WatchSource:0}: Error finding container 1fa9ca3f33161548091c2baadc3df25f90c65a191eddc138c11eb59f0a0eb033: Status 404 returned error can't find the container with id 1fa9ca3f33161548091c2baadc3df25f90c65a191eddc138c11eb59f0a0eb033 Oct 30 23:40:41.492680 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:41.492613 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" event={"ID":"1e79fb16-99e5-484f-b0a9-48986830b863","Type":"ContainerStarted","Data":"1fa9ca3f33161548091c2baadc3df25f90c65a191eddc138c11eb59f0a0eb033"} Oct 30 23:40:41.494172 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:41.494146 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" event={"ID":"e5b55296-9cd2-49dc-bc59-53ac290439a1","Type":"ContainerStarted","Data":"50354216799c19b02e0c47166c096d5ce6cd6790ed09381ec1528cfe5a92235b"} Oct 30 23:40:41.494323 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:41.494269 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" Oct 30 23:40:41.572636 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:41.572595 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" podStartSLOduration=1.818671622 podStartE2EDuration="5.572578892s" totalImagesPullingTime="3.75390727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:41.572132013 +0000 UTC m=+329.836037585" watchObservedRunningTime="2026-10-30 23:40:41.572578892 +0000 UTC m=+329.836484464" Oct 30 23:40:43.455191 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:43.455162 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-s6vkp" Oct 30 23:40:44.510944 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:44.510911 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" event={"ID":"1e79fb16-99e5-484f-b0a9-48986830b863","Type":"ContainerStarted","Data":"b22b1a9f1d42cb4bf88af367129bec28b6317fcbd08044a5b5afdd4889a12ede"} Oct 30 23:40:45.518412 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:45.518369 5112 generic.go:356] "Generic (PLEG): container finished" podID="1e79fb16-99e5-484f-b0a9-48986830b863" containerID="b22b1a9f1d42cb4bf88af367129bec28b6317fcbd08044a5b5afdd4889a12ede" exitCode=0 Oct 30 23:40:45.518817 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:45.518463 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" event={"ID":"1e79fb16-99e5-484f-b0a9-48986830b863","Type":"ContainerDied","Data":"b22b1a9f1d42cb4bf88af367129bec28b6317fcbd08044a5b5afdd4889a12ede"} Oct 30 23:40:46.525465 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:46.525426 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" event={"ID":"1e79fb16-99e5-484f-b0a9-48986830b863","Type":"ContainerStarted","Data":"b62fd0e35868296215044a368f956e54cf60a7423522f5cb6cba5cd3631db96e"} Oct 30 23:40:46.525926 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:46.525560 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:40:46.602359 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:46.602310 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" podStartSLOduration=2.981294521 podStartE2EDuration="6.602294834s" totalImagesPullingTime="3.198908463s" totalInitContainerRuntime="422.09185ms" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:46.589832065 +0000 UTC m=+334.853737679" watchObservedRunningTime="2026-10-30 23:40:46.602294834 +0000 UTC m=+334.866200407" Oct 30 23:40:52.502128 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:52.502086 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" Oct 30 23:40:52.973525 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:40:52.973448 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:40:52.990634 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:52.990610 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx"] Oct 30 23:40:52.993972 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:52.993954 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx" Oct 30 23:40:53.021235 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:53.021215 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx"] Oct 30 23:40:53.097152 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:53.097119 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/423009d1-3599-43f6-8427-56e32c100c47-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-2kfdx\" (UID: \"423009d1-3599-43f6-8427-56e32c100c47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx" Oct 30 23:40:53.097266 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:53.097163 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt65z\" (UniqueName: \"kubernetes.io/projected/423009d1-3599-43f6-8427-56e32c100c47-kube-api-access-tt65z\") pod \"kuadrant-operator-controller-manager-678d87766f-2kfdx\" (UID: \"423009d1-3599-43f6-8427-56e32c100c47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx" Oct 30 23:40:53.198066 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:53.198027 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt65z\" (UniqueName: \"kubernetes.io/projected/423009d1-3599-43f6-8427-56e32c100c47-kube-api-access-tt65z\") pod \"kuadrant-operator-controller-manager-678d87766f-2kfdx\" (UID: \"423009d1-3599-43f6-8427-56e32c100c47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx" Oct 30 23:40:53.198180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:53.198110 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/423009d1-3599-43f6-8427-56e32c100c47-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-2kfdx\" (UID: \"423009d1-3599-43f6-8427-56e32c100c47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx" Oct 30 23:40:53.198406 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:53.198389 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/423009d1-3599-43f6-8427-56e32c100c47-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-2kfdx\" (UID: \"423009d1-3599-43f6-8427-56e32c100c47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx" Oct 30 23:40:53.222277 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:53.222254 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt65z\" (UniqueName: \"kubernetes.io/projected/423009d1-3599-43f6-8427-56e32c100c47-kube-api-access-tt65z\") pod \"kuadrant-operator-controller-manager-678d87766f-2kfdx\" (UID: \"423009d1-3599-43f6-8427-56e32c100c47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx" Oct 30 23:40:53.306265 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:53.306237 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx" Oct 30 23:40:53.635402 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:53.635322 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx"] Oct 30 23:40:53.653157 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:40:53.653131 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423009d1_3599_43f6_8427_56e32c100c47.slice/crio-851a933f05be33017920ba7d165f947abeaafbe53c0ecf117be757bee6ba6371 WatchSource:0}: Error finding container 851a933f05be33017920ba7d165f947abeaafbe53c0ecf117be757bee6ba6371: Status 404 returned error can't find the container with id 851a933f05be33017920ba7d165f947abeaafbe53c0ecf117be757bee6ba6371 Oct 30 23:40:54.562855 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:54.562817 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx" event={"ID":"423009d1-3599-43f6-8427-56e32c100c47","Type":"ContainerStarted","Data":"040c316cb144e64b52717bb288aa9b66a2b646f696047ee8da10b5e8825fdd73"} Oct 30 23:40:54.563090 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:54.562922 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx" event={"ID":"423009d1-3599-43f6-8427-56e32c100c47","Type":"ContainerStarted","Data":"851a933f05be33017920ba7d165f947abeaafbe53c0ecf117be757bee6ba6371"} Oct 30 23:40:54.563090 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:54.562959 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx" Oct 30 23:40:54.637718 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:54.637669 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx" podStartSLOduration=2.637656733 podStartE2EDuration="2.637656733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:54.625640507 +0000 UTC m=+342.889546079" watchObservedRunningTime="2026-10-30 23:40:54.637656733 +0000 UTC m=+342.901562305" Oct 30 23:40:57.532873 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:40:57.532840 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-hbztc" Oct 30 23:41:05.570795 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:05.570760 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2kfdx" Oct 30 23:41:05.662948 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:05.662915 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds"] Oct 30 23:41:05.663205 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:05.663163 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" podUID="e5b55296-9cd2-49dc-bc59-53ac290439a1" containerName="manager" containerID="cri-o://50354216799c19b02e0c47166c096d5ce6cd6790ed09381ec1528cfe5a92235b" gracePeriod=10 Oct 30 23:41:05.904868 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:05.904845 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" Oct 30 23:41:06.094676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:06.094594 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e5b55296-9cd2-49dc-bc59-53ac290439a1-kube-api-access-qvq7m\" (UniqueName: \"kubernetes.io/projected/e5b55296-9cd2-49dc-bc59-53ac290439a1-kube-api-access-qvq7m\") pod \"e5b55296-9cd2-49dc-bc59-53ac290439a1\" (UID: \"e5b55296-9cd2-49dc-bc59-53ac290439a1\") " Oct 30 23:41:06.094676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:06.094655 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5b55296-9cd2-49dc-bc59-53ac290439a1-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5b55296-9cd2-49dc-bc59-53ac290439a1-extensions-socket-volume\") pod \"e5b55296-9cd2-49dc-bc59-53ac290439a1\" (UID: \"e5b55296-9cd2-49dc-bc59-53ac290439a1\") " Oct 30 23:41:06.095151 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:06.095126 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5b55296-9cd2-49dc-bc59-53ac290439a1-extensions-socket-volume" pod "e5b55296-9cd2-49dc-bc59-53ac290439a1" (UID: "e5b55296-9cd2-49dc-bc59-53ac290439a1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:41:06.096745 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:06.096723 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5b55296-9cd2-49dc-bc59-53ac290439a1-kube-api-access-qvq7m" pod "e5b55296-9cd2-49dc-bc59-53ac290439a1" (UID: "e5b55296-9cd2-49dc-bc59-53ac290439a1"). InnerVolumeSpecName "kube-api-access-qvq7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:41:06.195796 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:06.195773 5112 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5b55296-9cd2-49dc-bc59-53ac290439a1-extensions-socket-volume\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:41:06.195796 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:06.195793 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvq7m\" (UniqueName: \"kubernetes.io/projected/e5b55296-9cd2-49dc-bc59-53ac290439a1-kube-api-access-qvq7m\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:41:06.623301 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:06.623274 5112 generic.go:356] "Generic (PLEG): container finished" podID="e5b55296-9cd2-49dc-bc59-53ac290439a1" containerID="50354216799c19b02e0c47166c096d5ce6cd6790ed09381ec1528cfe5a92235b" exitCode=0 Oct 30 23:41:06.623646 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:06.623330 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" Oct 30 23:41:06.623646 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:06.623364 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" event={"ID":"e5b55296-9cd2-49dc-bc59-53ac290439a1","Type":"ContainerDied","Data":"50354216799c19b02e0c47166c096d5ce6cd6790ed09381ec1528cfe5a92235b"} Oct 30 23:41:06.623646 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:06.623431 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds" event={"ID":"e5b55296-9cd2-49dc-bc59-53ac290439a1","Type":"ContainerDied","Data":"32b0a3b0eaba802f2dc915a0ff7f2928569ad6aff08f19e0f8bab4806c6753e3"} Oct 30 23:41:06.623646 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:06.623461 5112 scope.go:122] "RemoveContainer" containerID="50354216799c19b02e0c47166c096d5ce6cd6790ed09381ec1528cfe5a92235b" Oct 30 23:41:06.633561 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:06.633543 5112 scope.go:122] "RemoveContainer" containerID="50354216799c19b02e0c47166c096d5ce6cd6790ed09381ec1528cfe5a92235b" Oct 30 23:41:06.633886 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:41:06.633865 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50354216799c19b02e0c47166c096d5ce6cd6790ed09381ec1528cfe5a92235b\": container with ID starting with 50354216799c19b02e0c47166c096d5ce6cd6790ed09381ec1528cfe5a92235b not found: ID does not exist" containerID="50354216799c19b02e0c47166c096d5ce6cd6790ed09381ec1528cfe5a92235b" Oct 30 23:41:06.634027 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:06.633895 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50354216799c19b02e0c47166c096d5ce6cd6790ed09381ec1528cfe5a92235b"} err="failed to get container status \"50354216799c19b02e0c47166c096d5ce6cd6790ed09381ec1528cfe5a92235b\": rpc error: code = NotFound desc = could not find container \"50354216799c19b02e0c47166c096d5ce6cd6790ed09381ec1528cfe5a92235b\": container with ID starting with 50354216799c19b02e0c47166c096d5ce6cd6790ed09381ec1528cfe5a92235b not found: ID does not exist" Oct 30 23:41:06.706503 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:06.706478 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds"] Oct 30 23:41:06.717582 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:06.717560 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-trkds"] Oct 30 23:41:07.874799 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:07.874757 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e5b55296-9cd2-49dc-bc59-53ac290439a1" path="/var/lib/kubelet/pods/e5b55296-9cd2-49dc-bc59-53ac290439a1/volumes" Oct 30 23:41:13.118947 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.118910 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9"] Oct 30 23:41:13.119479 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.119460 5112 cpu_manager.go:414] "containerMap: removing container" podUID="e5b55296-9cd2-49dc-bc59-53ac290439a1" containerName="manager" Oct 30 23:41:13.119581 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.119492 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e5b55296-9cd2-49dc-bc59-53ac290439a1" containerName="manager" Oct 30 23:41:13.119643 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.119607 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="e5b55296-9cd2-49dc-bc59-53ac290439a1" containerName="manager" Oct 30 23:41:13.124468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.124448 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.144677 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.144652 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9"] Oct 30 23:41:13.148474 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.148453 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dffa18cd-835f-49ec-b205-20d8b993a068-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.148571 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.148482 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfkcm\" (UniqueName: \"kubernetes.io/projected/dffa18cd-835f-49ec-b205-20d8b993a068-kube-api-access-tfkcm\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.148571 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.148511 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dffa18cd-835f-49ec-b205-20d8b993a068-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.148679 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.148651 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dffa18cd-835f-49ec-b205-20d8b993a068-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.148724 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.148709 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dffa18cd-835f-49ec-b205-20d8b993a068-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.148764 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.148742 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dffa18cd-835f-49ec-b205-20d8b993a068-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.148821 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.148774 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dffa18cd-835f-49ec-b205-20d8b993a068-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.148908 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.148888 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dffa18cd-835f-49ec-b205-20d8b993a068-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.148964 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.148942 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dffa18cd-835f-49ec-b205-20d8b993a068-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.219770 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.219743 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cspxx\"" Oct 30 23:41:13.249858 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.249828 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dffa18cd-835f-49ec-b205-20d8b993a068-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.249979 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.249871 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dffa18cd-835f-49ec-b205-20d8b993a068-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.249979 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.249902 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dffa18cd-835f-49ec-b205-20d8b993a068-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.250133 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.250006 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfkcm\" (UniqueName: \"kubernetes.io/projected/dffa18cd-835f-49ec-b205-20d8b993a068-kube-api-access-tfkcm\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.250133 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.250061 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dffa18cd-835f-49ec-b205-20d8b993a068-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.250133 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.250096 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dffa18cd-835f-49ec-b205-20d8b993a068-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.250286 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.250132 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dffa18cd-835f-49ec-b205-20d8b993a068-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.250286 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.250160 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dffa18cd-835f-49ec-b205-20d8b993a068-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.250388 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.250287 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dffa18cd-835f-49ec-b205-20d8b993a068-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.250388 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.250328 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dffa18cd-835f-49ec-b205-20d8b993a068-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.250477 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.250391 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dffa18cd-835f-49ec-b205-20d8b993a068-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.250477 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.250456 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dffa18cd-835f-49ec-b205-20d8b993a068-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.250539 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.250517 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dffa18cd-835f-49ec-b205-20d8b993a068-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.250892 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.250869 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dffa18cd-835f-49ec-b205-20d8b993a068-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.252324 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.252307 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dffa18cd-835f-49ec-b205-20d8b993a068-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.252557 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.252540 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dffa18cd-835f-49ec-b205-20d8b993a068-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.267812 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.267790 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfkcm\" (UniqueName: \"kubernetes.io/projected/dffa18cd-835f-49ec-b205-20d8b993a068-kube-api-access-tfkcm\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.268256 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.268235 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dffa18cd-835f-49ec-b205-20d8b993a068-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9\" (UID: \"dffa18cd-835f-49ec-b205-20d8b993a068\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.437144 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.437088 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:13.750875 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.750843 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9"] Oct 30 23:41:13.756029 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:41:13.755997 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddffa18cd_835f_49ec_b205_20d8b993a068.slice/crio-72f218f3884bb7191d2f218cecabb992bc03e3a15eab57be3fb350bafbdb29a0 WatchSource:0}: Error finding container 72f218f3884bb7191d2f218cecabb992bc03e3a15eab57be3fb350bafbdb29a0: Status 404 returned error can't find the container with id 72f218f3884bb7191d2f218cecabb992bc03e3a15eab57be3fb350bafbdb29a0 Oct 30 23:41:13.758247 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.758219 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:41:13.758311 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.758291 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:41:13.758347 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:13.758321 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:41:14.673201 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:14.673162 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" event={"ID":"dffa18cd-835f-49ec-b205-20d8b993a068","Type":"ContainerStarted","Data":"aa9be79aed18f455f23941c65a535fae4dc66596394a0678ac5470d13c75fa22"} Oct 30 23:41:14.673728 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:14.673216 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" event={"ID":"dffa18cd-835f-49ec-b205-20d8b993a068","Type":"ContainerStarted","Data":"72f218f3884bb7191d2f218cecabb992bc03e3a15eab57be3fb350bafbdb29a0"} Oct 30 23:41:14.718165 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:14.718120 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" podStartSLOduration=1.718106507 podStartE2EDuration="1.718106507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:41:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:41:14.716437625 +0000 UTC m=+362.980343343" watchObservedRunningTime="2026-10-30 23:41:14.718106507 +0000 UTC m=+362.982012078" Oct 30 23:41:15.437339 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:15.437301 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:15.442341 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:15.442312 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:15.678383 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:15.678356 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:15.679226 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:15.679212 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9" Oct 30 23:41:17.283015 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.282978 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt"] Oct 30 23:41:17.286815 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.286797 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:17.304561 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.304537 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt"] Oct 30 23:41:17.314230 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.314206 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Oct 30 23:41:17.314230 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.314224 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Oct 30 23:41:17.314463 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.314276 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Oct 30 23:41:17.314463 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.314367 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Oct 30 23:41:17.314463 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.314393 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:41:17.314463 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.314418 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-4qzhh\"" Oct 30 23:41:17.383578 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.383553 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/172a9583-028e-4d12-8705-6092c794adf7-metrics-certs\") pod \"jobset-controller-manager-696f8dc884-wnlkt\" (UID: \"172a9583-028e-4d12-8705-6092c794adf7\") " pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:17.383670 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.383592 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/172a9583-028e-4d12-8705-6092c794adf7-manager-config\") pod \"jobset-controller-manager-696f8dc884-wnlkt\" (UID: \"172a9583-028e-4d12-8705-6092c794adf7\") " pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:17.383730 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.383672 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sn2t\" (UniqueName: \"kubernetes.io/projected/172a9583-028e-4d12-8705-6092c794adf7-kube-api-access-4sn2t\") pod \"jobset-controller-manager-696f8dc884-wnlkt\" (UID: \"172a9583-028e-4d12-8705-6092c794adf7\") " pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:17.383776 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.383735 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/172a9583-028e-4d12-8705-6092c794adf7-cert\") pod \"jobset-controller-manager-696f8dc884-wnlkt\" (UID: \"172a9583-028e-4d12-8705-6092c794adf7\") " pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:17.484586 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.484567 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/172a9583-028e-4d12-8705-6092c794adf7-metrics-certs\") pod \"jobset-controller-manager-696f8dc884-wnlkt\" (UID: \"172a9583-028e-4d12-8705-6092c794adf7\") " pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:17.484696 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.484596 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/172a9583-028e-4d12-8705-6092c794adf7-manager-config\") pod \"jobset-controller-manager-696f8dc884-wnlkt\" (UID: \"172a9583-028e-4d12-8705-6092c794adf7\") " pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:17.484696 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.484625 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sn2t\" (UniqueName: \"kubernetes.io/projected/172a9583-028e-4d12-8705-6092c794adf7-kube-api-access-4sn2t\") pod \"jobset-controller-manager-696f8dc884-wnlkt\" (UID: \"172a9583-028e-4d12-8705-6092c794adf7\") " pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:17.484696 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.484667 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/172a9583-028e-4d12-8705-6092c794adf7-cert\") pod \"jobset-controller-manager-696f8dc884-wnlkt\" (UID: \"172a9583-028e-4d12-8705-6092c794adf7\") " pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:17.485436 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.485415 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/172a9583-028e-4d12-8705-6092c794adf7-manager-config\") pod \"jobset-controller-manager-696f8dc884-wnlkt\" (UID: \"172a9583-028e-4d12-8705-6092c794adf7\") " pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:17.487102 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.487082 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/172a9583-028e-4d12-8705-6092c794adf7-cert\") pod \"jobset-controller-manager-696f8dc884-wnlkt\" (UID: \"172a9583-028e-4d12-8705-6092c794adf7\") " pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:17.487176 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.487142 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/172a9583-028e-4d12-8705-6092c794adf7-metrics-certs\") pod \"jobset-controller-manager-696f8dc884-wnlkt\" (UID: \"172a9583-028e-4d12-8705-6092c794adf7\") " pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:17.502106 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.502083 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sn2t\" (UniqueName: \"kubernetes.io/projected/172a9583-028e-4d12-8705-6092c794adf7-kube-api-access-4sn2t\") pod \"jobset-controller-manager-696f8dc884-wnlkt\" (UID: \"172a9583-028e-4d12-8705-6092c794adf7\") " pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:17.598722 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.598664 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:17.892018 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:17.891951 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt"] Oct 30 23:41:17.896686 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:41:17.896649 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172a9583_028e_4d12_8705_6092c794adf7.slice/crio-4e27ea1c6e38ab53c4bdf55ec4a0d61a42ed521910cd03ed96b4aa54f39aa92e WatchSource:0}: Error finding container 4e27ea1c6e38ab53c4bdf55ec4a0d61a42ed521910cd03ed96b4aa54f39aa92e: Status 404 returned error can't find the container with id 4e27ea1c6e38ab53c4bdf55ec4a0d61a42ed521910cd03ed96b4aa54f39aa92e Oct 30 23:41:18.699846 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:18.699808 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" event={"ID":"172a9583-028e-4d12-8705-6092c794adf7","Type":"ContainerStarted","Data":"4e27ea1c6e38ab53c4bdf55ec4a0d61a42ed521910cd03ed96b4aa54f39aa92e"} Oct 30 23:41:20.714400 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:20.714051 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" event={"ID":"172a9583-028e-4d12-8705-6092c794adf7","Type":"ContainerStarted","Data":"527055ea13338bfacb2b086fe86191e681360729be1ace3f57020ac2ef03d70e"} Oct 30 23:41:20.714400 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:20.714176 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:20.753173 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:20.753128 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" podStartSLOduration=1.040894944 podStartE2EDuration="3.753114376s" totalImagesPullingTime="2.712219432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:41:20.752539749 +0000 UTC m=+369.016445321" watchObservedRunningTime="2026-10-30 23:41:20.753114376 +0000 UTC m=+369.017019947" Oct 30 23:41:22.259235 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:22.259201 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-swwjn"] Oct 30 23:41:22.262795 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:22.262778 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-swwjn" Oct 30 23:41:22.278730 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:22.278665 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-swwjn"] Oct 30 23:41:22.287964 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:22.287946 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gk475\"" Oct 30 23:41:22.324354 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:22.324330 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tqct\" (UniqueName: \"kubernetes.io/projected/2447f7a4-82a0-4701-8601-0f63039071b0-kube-api-access-2tqct\") pod \"authorino-56c6c9ddd5-swwjn\" (UID: \"2447f7a4-82a0-4701-8601-0f63039071b0\") " pod="kuadrant-system/authorino-56c6c9ddd5-swwjn" Oct 30 23:41:22.425663 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:22.425637 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tqct\" (UniqueName: \"kubernetes.io/projected/2447f7a4-82a0-4701-8601-0f63039071b0-kube-api-access-2tqct\") pod \"authorino-56c6c9ddd5-swwjn\" (UID: \"2447f7a4-82a0-4701-8601-0f63039071b0\") " pod="kuadrant-system/authorino-56c6c9ddd5-swwjn" Oct 30 23:41:22.445988 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:22.445958 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tqct\" (UniqueName: \"kubernetes.io/projected/2447f7a4-82a0-4701-8601-0f63039071b0-kube-api-access-2tqct\") pod \"authorino-56c6c9ddd5-swwjn\" (UID: \"2447f7a4-82a0-4701-8601-0f63039071b0\") " pod="kuadrant-system/authorino-56c6c9ddd5-swwjn" Oct 30 23:41:22.586632 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:22.586575 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-swwjn" Oct 30 23:41:22.878440 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:22.878362 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-swwjn"] Oct 30 23:41:22.883961 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:41:22.883928 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2447f7a4_82a0_4701_8601_0f63039071b0.slice/crio-41cc9f3f3fa01a32dd9a395aa235a53b718ed7119a077a4531150e167f0e6140 WatchSource:0}: Error finding container 41cc9f3f3fa01a32dd9a395aa235a53b718ed7119a077a4531150e167f0e6140: Status 404 returned error can't find the container with id 41cc9f3f3fa01a32dd9a395aa235a53b718ed7119a077a4531150e167f0e6140 Oct 30 23:41:22.973735 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:41:22.973704 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:41:23.731106 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:23.731066 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-swwjn" event={"ID":"2447f7a4-82a0-4701-8601-0f63039071b0","Type":"ContainerStarted","Data":"41cc9f3f3fa01a32dd9a395aa235a53b718ed7119a077a4531150e167f0e6140"} Oct 30 23:41:24.736991 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:24.736914 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-swwjn" event={"ID":"2447f7a4-82a0-4701-8601-0f63039071b0","Type":"ContainerStarted","Data":"1c9bd74f5043baeb0119e4bffbfb1e78494c06772706f3eda86e44b38dad4ec3"} Oct 30 23:41:24.773235 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:24.773191 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-swwjn" podStartSLOduration=1.300201666 podStartE2EDuration="2.773178542s" totalImagesPullingTime="1.472976876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:41:24.771533826 +0000 UTC m=+373.035439399" watchObservedRunningTime="2026-10-30 23:41:24.773178542 +0000 UTC m=+373.037084114" Oct 30 23:41:31.724412 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:41:31.724370 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-696f8dc884-wnlkt" Oct 30 23:41:52.976942 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:41:52.976847 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:42:11.894441 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:11.894412 5112 scope.go:122] "RemoveContainer" containerID="93d073df8e2ee21028a35073e584e1f9c38602808303099fbabbbbbcfcfcc2b0" Oct 30 23:42:15.106707 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.106677 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-54vs2"] Oct 30 23:42:15.111916 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.111896 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-54vs2" Oct 30 23:42:15.140843 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.140814 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ea3769f-4528-4091-bd9b-5f6411392ffc-cert\") pod \"kserve-controller-manager-776cc66d47-54vs2\" (UID: \"5ea3769f-4528-4091-bd9b-5f6411392ffc\") " pod="opendatahub/kserve-controller-manager-776cc66d47-54vs2" Oct 30 23:42:15.140971 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.140889 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvj8w\" (UniqueName: \"kubernetes.io/projected/5ea3769f-4528-4091-bd9b-5f6411392ffc-kube-api-access-vvj8w\") pod \"kserve-controller-manager-776cc66d47-54vs2\" (UID: \"5ea3769f-4528-4091-bd9b-5f6411392ffc\") " pod="opendatahub/kserve-controller-manager-776cc66d47-54vs2" Oct 30 23:42:15.143299 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.143270 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-h9nbs\"" Oct 30 23:42:15.143524 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.143300 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Oct 30 23:42:15.143524 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.143375 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Oct 30 23:42:15.143524 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.143459 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Oct 30 23:42:15.145149 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.145127 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-54vs2"] Oct 30 23:42:15.232437 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.232413 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-4k5cv"] Oct 30 23:42:15.235856 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.235836 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-4k5cv" Oct 30 23:42:15.241427 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.241395 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ea3769f-4528-4091-bd9b-5f6411392ffc-cert\") pod \"kserve-controller-manager-776cc66d47-54vs2\" (UID: \"5ea3769f-4528-4091-bd9b-5f6411392ffc\") " pod="opendatahub/kserve-controller-manager-776cc66d47-54vs2" Oct 30 23:42:15.241535 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.241492 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvj8w\" (UniqueName: \"kubernetes.io/projected/5ea3769f-4528-4091-bd9b-5f6411392ffc-kube-api-access-vvj8w\") pod \"kserve-controller-manager-776cc66d47-54vs2\" (UID: \"5ea3769f-4528-4091-bd9b-5f6411392ffc\") " pod="opendatahub/kserve-controller-manager-776cc66d47-54vs2" Oct 30 23:42:15.241813 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.241793 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d0cf9be-513f-4f2b-8a10-892d53bf4538-tls-certs\") pod \"model-serving-api-75bd89fdfc-4k5cv\" (UID: \"8d0cf9be-513f-4f2b-8a10-892d53bf4538\") " pod="opendatahub/model-serving-api-75bd89fdfc-4k5cv" Oct 30 23:42:15.241874 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.241857 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4cgq\" (UniqueName: \"kubernetes.io/projected/8d0cf9be-513f-4f2b-8a10-892d53bf4538-kube-api-access-m4cgq\") pod \"model-serving-api-75bd89fdfc-4k5cv\" (UID: \"8d0cf9be-513f-4f2b-8a10-892d53bf4538\") " pod="opendatahub/model-serving-api-75bd89fdfc-4k5cv" Oct 30 23:42:15.243991 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.243970 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ea3769f-4528-4091-bd9b-5f6411392ffc-cert\") pod \"kserve-controller-manager-776cc66d47-54vs2\" (UID: \"5ea3769f-4528-4091-bd9b-5f6411392ffc\") " pod="opendatahub/kserve-controller-manager-776cc66d47-54vs2" Oct 30 23:42:15.252100 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.252081 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Oct 30 23:42:15.252185 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.252113 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-f7vpl\"" Oct 30 23:42:15.265061 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.265021 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-4k5cv"] Oct 30 23:42:15.267577 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.267556 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvj8w\" (UniqueName: \"kubernetes.io/projected/5ea3769f-4528-4091-bd9b-5f6411392ffc-kube-api-access-vvj8w\") pod \"kserve-controller-manager-776cc66d47-54vs2\" (UID: \"5ea3769f-4528-4091-bd9b-5f6411392ffc\") " pod="opendatahub/kserve-controller-manager-776cc66d47-54vs2" Oct 30 23:42:15.305841 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.305821 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-nkcj2"] Oct 30 23:42:15.309349 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.309334 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-nkcj2" Oct 30 23:42:15.342006 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.341800 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-nkcj2"] Oct 30 23:42:15.342462 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.342439 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30b5baa9-257c-4b8a-b460-ac78c5362e5c-cert\") pod \"odh-model-controller-769875db56-nkcj2\" (UID: \"30b5baa9-257c-4b8a-b460-ac78c5362e5c\") " pod="opendatahub/odh-model-controller-769875db56-nkcj2" Oct 30 23:42:15.342566 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.342522 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30b5baa9-257c-4b8a-b460-ac78c5362e5c-metrics-certs\") pod \"odh-model-controller-769875db56-nkcj2\" (UID: \"30b5baa9-257c-4b8a-b460-ac78c5362e5c\") " pod="opendatahub/odh-model-controller-769875db56-nkcj2" Oct 30 23:42:15.342643 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.342622 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d0cf9be-513f-4f2b-8a10-892d53bf4538-tls-certs\") pod \"model-serving-api-75bd89fdfc-4k5cv\" (UID: \"8d0cf9be-513f-4f2b-8a10-892d53bf4538\") " pod="opendatahub/model-serving-api-75bd89fdfc-4k5cv" Oct 30 23:42:15.342701 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.342650 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twwf9\" (UniqueName: \"kubernetes.io/projected/30b5baa9-257c-4b8a-b460-ac78c5362e5c-kube-api-access-twwf9\") pod \"odh-model-controller-769875db56-nkcj2\" (UID: \"30b5baa9-257c-4b8a-b460-ac78c5362e5c\") " pod="opendatahub/odh-model-controller-769875db56-nkcj2" Oct 30 23:42:15.342760 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.342703 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4cgq\" (UniqueName: \"kubernetes.io/projected/8d0cf9be-513f-4f2b-8a10-892d53bf4538-kube-api-access-m4cgq\") pod \"model-serving-api-75bd89fdfc-4k5cv\" (UID: \"8d0cf9be-513f-4f2b-8a10-892d53bf4538\") " pod="opendatahub/model-serving-api-75bd89fdfc-4k5cv" Oct 30 23:42:15.345237 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.345204 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d0cf9be-513f-4f2b-8a10-892d53bf4538-tls-certs\") pod \"model-serving-api-75bd89fdfc-4k5cv\" (UID: \"8d0cf9be-513f-4f2b-8a10-892d53bf4538\") " pod="opendatahub/model-serving-api-75bd89fdfc-4k5cv" Oct 30 23:42:15.352923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.352904 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hzrwx\"" Oct 30 23:42:15.352999 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.352927 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Oct 30 23:42:15.352999 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.352987 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\"" Oct 30 23:42:15.367271 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.367225 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4cgq\" (UniqueName: \"kubernetes.io/projected/8d0cf9be-513f-4f2b-8a10-892d53bf4538-kube-api-access-m4cgq\") pod \"model-serving-api-75bd89fdfc-4k5cv\" (UID: \"8d0cf9be-513f-4f2b-8a10-892d53bf4538\") " pod="opendatahub/model-serving-api-75bd89fdfc-4k5cv" Oct 30 23:42:15.424007 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.423984 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-54vs2" Oct 30 23:42:15.443315 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.443294 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30b5baa9-257c-4b8a-b460-ac78c5362e5c-metrics-certs\") pod \"odh-model-controller-769875db56-nkcj2\" (UID: \"30b5baa9-257c-4b8a-b460-ac78c5362e5c\") " pod="opendatahub/odh-model-controller-769875db56-nkcj2" Oct 30 23:42:15.443417 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.443336 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twwf9\" (UniqueName: \"kubernetes.io/projected/30b5baa9-257c-4b8a-b460-ac78c5362e5c-kube-api-access-twwf9\") pod \"odh-model-controller-769875db56-nkcj2\" (UID: \"30b5baa9-257c-4b8a-b460-ac78c5362e5c\") " pod="opendatahub/odh-model-controller-769875db56-nkcj2" Oct 30 23:42:15.443417 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.443370 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30b5baa9-257c-4b8a-b460-ac78c5362e5c-cert\") pod \"odh-model-controller-769875db56-nkcj2\" (UID: \"30b5baa9-257c-4b8a-b460-ac78c5362e5c\") " pod="opendatahub/odh-model-controller-769875db56-nkcj2" Oct 30 23:42:15.445523 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.445502 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30b5baa9-257c-4b8a-b460-ac78c5362e5c-cert\") pod \"odh-model-controller-769875db56-nkcj2\" (UID: \"30b5baa9-257c-4b8a-b460-ac78c5362e5c\") " pod="opendatahub/odh-model-controller-769875db56-nkcj2" Oct 30 23:42:15.445610 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.445561 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30b5baa9-257c-4b8a-b460-ac78c5362e5c-metrics-certs\") pod \"odh-model-controller-769875db56-nkcj2\" (UID: \"30b5baa9-257c-4b8a-b460-ac78c5362e5c\") " pod="opendatahub/odh-model-controller-769875db56-nkcj2" Oct 30 23:42:15.466442 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.466417 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twwf9\" (UniqueName: \"kubernetes.io/projected/30b5baa9-257c-4b8a-b460-ac78c5362e5c-kube-api-access-twwf9\") pod \"odh-model-controller-769875db56-nkcj2\" (UID: \"30b5baa9-257c-4b8a-b460-ac78c5362e5c\") " pod="opendatahub/odh-model-controller-769875db56-nkcj2" Oct 30 23:42:15.549498 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.549458 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-4k5cv" Oct 30 23:42:15.621244 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.621177 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-nkcj2" Oct 30 23:42:15.723373 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.723349 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-54vs2"] Oct 30 23:42:15.727772 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:42:15.727745 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ea3769f_4528_4091_bd9b_5f6411392ffc.slice/crio-e428151bd6b7fde55117227f87bf392f52401c53a1fe799ba27fab3c5ce84e34 WatchSource:0}: Error finding container e428151bd6b7fde55117227f87bf392f52401c53a1fe799ba27fab3c5ce84e34: Status 404 returned error can't find the container with id e428151bd6b7fde55117227f87bf392f52401c53a1fe799ba27fab3c5ce84e34 Oct 30 23:42:15.843216 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.843187 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-4k5cv"] Oct 30 23:42:15.847109 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:42:15.847071 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d0cf9be_513f_4f2b_8a10_892d53bf4538.slice/crio-fdc64eb45c7549edb045c98b54b1a170f0ac775734640196e5d5230840dc02e6 WatchSource:0}: Error finding container fdc64eb45c7549edb045c98b54b1a170f0ac775734640196e5d5230840dc02e6: Status 404 returned error can't find the container with id fdc64eb45c7549edb045c98b54b1a170f0ac775734640196e5d5230840dc02e6 Oct 30 23:42:15.916974 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.916920 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-nkcj2"] Oct 30 23:42:15.921200 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:42:15.921178 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b5baa9_257c_4b8a_b460_ac78c5362e5c.slice/crio-b36bf967b0768dca81af250dd2b319cc3241fb56031bb9153132089e777b3f5f WatchSource:0}: Error finding container b36bf967b0768dca81af250dd2b319cc3241fb56031bb9153132089e777b3f5f: Status 404 returned error can't find the container with id b36bf967b0768dca81af250dd2b319cc3241fb56031bb9153132089e777b3f5f Oct 30 23:42:15.997745 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.997719 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-4k5cv" event={"ID":"8d0cf9be-513f-4f2b-8a10-892d53bf4538","Type":"ContainerStarted","Data":"fdc64eb45c7549edb045c98b54b1a170f0ac775734640196e5d5230840dc02e6"} Oct 30 23:42:15.998908 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.998882 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-54vs2" event={"ID":"5ea3769f-4528-4091-bd9b-5f6411392ffc","Type":"ContainerStarted","Data":"e428151bd6b7fde55117227f87bf392f52401c53a1fe799ba27fab3c5ce84e34"} Oct 30 23:42:15.999960 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:15.999943 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-nkcj2" event={"ID":"30b5baa9-257c-4b8a-b460-ac78c5362e5c","Type":"ContainerStarted","Data":"b36bf967b0768dca81af250dd2b319cc3241fb56031bb9153132089e777b3f5f"} Oct 30 23:42:19.028845 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:19.028792 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-4k5cv" event={"ID":"8d0cf9be-513f-4f2b-8a10-892d53bf4538","Type":"ContainerStarted","Data":"c8ccfd896d22324e1346f45350d87dc3d88d0aaeeff2f4b5b09c9968c0993a87"} Oct 30 23:42:19.029322 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:19.029080 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-4k5cv" Oct 30 23:42:19.072768 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:19.072711 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-4k5cv" podStartSLOduration=1.5556253 podStartE2EDuration="4.07269351s" totalImagesPullingTime="2.51706821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:42:19.071756763 +0000 UTC m=+427.335662337" watchObservedRunningTime="2026-10-30 23:42:19.07269351 +0000 UTC m=+427.336599135" Oct 30 23:42:20.035029 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:20.034990 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-54vs2" event={"ID":"5ea3769f-4528-4091-bd9b-5f6411392ffc","Type":"ContainerStarted","Data":"3ea1af1bc5157cc0bebc2f0c209d465e6d855d92f2e7c8cdef1a8ef56998d069"} Oct 30 23:42:20.035461 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:20.035073 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-54vs2" Oct 30 23:42:20.036647 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:20.036621 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-nkcj2" event={"ID":"30b5baa9-257c-4b8a-b460-ac78c5362e5c","Type":"ContainerStarted","Data":"79f2c3cb0b8acf26d284e5d3f97eb0a136237b702a1ed53796dd7885bbab135e"} Oct 30 23:42:20.036765 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:20.036745 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-nkcj2" Oct 30 23:42:20.080204 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:20.080149 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-54vs2" podStartSLOduration=1.488899243 podStartE2EDuration="5.080123638s" totalImagesPullingTime="3.591224395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:42:20.080009094 +0000 UTC m=+428.343914666" watchObservedRunningTime="2026-10-30 23:42:20.080123638 +0000 UTC m=+428.344029210" Oct 30 23:42:20.122540 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:20.122482 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-nkcj2" podStartSLOduration=1.726692363 podStartE2EDuration="5.122467441s" totalImagesPullingTime="3.395775078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:42:20.121695067 +0000 UTC m=+428.385600636" watchObservedRunningTime="2026-10-30 23:42:20.122467441 +0000 UTC m=+428.386373015" Oct 30 23:42:22.973954 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:42:22.973914 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:42:30.041393 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:30.041366 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-4k5cv" Oct 30 23:42:31.043744 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:31.043712 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-nkcj2" Oct 30 23:42:51.046170 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:51.046137 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-54vs2" Oct 30 23:42:52.977284 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:42:52.977242 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:42:58.243373 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.243343 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67dcc64f86-46swt"] Oct 30 23:42:58.246900 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.246882 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67dcc64f86-46swt" Oct 30 23:42:58.266979 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.266955 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Oct 30 23:42:58.275278 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.275257 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Oct 30 23:42:58.275393 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.275278 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Oct 30 23:42:58.276929 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.276907 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67dcc64f86-46swt"] Oct 30 23:42:58.278454 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.278439 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kbtjg\"" Oct 30 23:42:58.387219 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.387191 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfz5c\" (UniqueName: \"kubernetes.io/projected/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-kube-api-access-cfz5c\") pod \"maas-controller-67dcc64f86-46swt\" (UID: \"d05b8e5b-6330-4c62-a2b9-67a69acfbee8\") " pod="opendatahub/maas-controller-67dcc64f86-46swt" Oct 30 23:42:58.387351 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.387282 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-webhook-cert\") pod \"maas-controller-67dcc64f86-46swt\" (UID: \"d05b8e5b-6330-4c62-a2b9-67a69acfbee8\") " pod="opendatahub/maas-controller-67dcc64f86-46swt" Oct 30 23:42:58.387351 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.387322 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-metrics-certs\") pod \"maas-controller-67dcc64f86-46swt\" (UID: \"d05b8e5b-6330-4c62-a2b9-67a69acfbee8\") " pod="opendatahub/maas-controller-67dcc64f86-46swt" Oct 30 23:42:58.487650 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.487620 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfz5c\" (UniqueName: \"kubernetes.io/projected/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-kube-api-access-cfz5c\") pod \"maas-controller-67dcc64f86-46swt\" (UID: \"d05b8e5b-6330-4c62-a2b9-67a69acfbee8\") " pod="opendatahub/maas-controller-67dcc64f86-46swt" Oct 30 23:42:58.487754 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.487677 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-webhook-cert\") pod \"maas-controller-67dcc64f86-46swt\" (UID: \"d05b8e5b-6330-4c62-a2b9-67a69acfbee8\") " pod="opendatahub/maas-controller-67dcc64f86-46swt" Oct 30 23:42:58.487754 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.487698 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-metrics-certs\") pod \"maas-controller-67dcc64f86-46swt\" (UID: \"d05b8e5b-6330-4c62-a2b9-67a69acfbee8\") " pod="opendatahub/maas-controller-67dcc64f86-46swt" Oct 30 23:42:58.490218 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.490193 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-webhook-cert\") pod \"maas-controller-67dcc64f86-46swt\" (UID: \"d05b8e5b-6330-4c62-a2b9-67a69acfbee8\") " pod="opendatahub/maas-controller-67dcc64f86-46swt" Oct 30 23:42:58.490437 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.490415 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-metrics-certs\") pod \"maas-controller-67dcc64f86-46swt\" (UID: \"d05b8e5b-6330-4c62-a2b9-67a69acfbee8\") " pod="opendatahub/maas-controller-67dcc64f86-46swt" Oct 30 23:42:58.506596 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.506571 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfz5c\" (UniqueName: \"kubernetes.io/projected/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-kube-api-access-cfz5c\") pod \"maas-controller-67dcc64f86-46swt\" (UID: \"d05b8e5b-6330-4c62-a2b9-67a69acfbee8\") " pod="opendatahub/maas-controller-67dcc64f86-46swt" Oct 30 23:42:58.559215 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.559190 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67dcc64f86-46swt" Oct 30 23:42:58.772128 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.772033 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b77d68475-n859k"] Oct 30 23:42:58.775834 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.775814 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b77d68475-n859k" Oct 30 23:42:58.800628 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.800605 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b77d68475-n859k"] Oct 30 23:42:58.878347 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.878323 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67dcc64f86-46swt"] Oct 30 23:42:58.882516 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:42:58.882495 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd05b8e5b_6330_4c62_a2b9_67a69acfbee8.slice/crio-664819876e70015ed96ce631be8f937cc36a698b5409d55670ad60b651cfa576 WatchSource:0}: Error finding container 664819876e70015ed96ce631be8f937cc36a698b5409d55670ad60b651cfa576: Status 404 returned error can't find the container with id 664819876e70015ed96ce631be8f937cc36a698b5409d55670ad60b651cfa576 Oct 30 23:42:58.891650 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.891629 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39595a37-9ed7-429f-a209-954130586e38-webhook-cert\") pod \"maas-controller-5b77d68475-n859k\" (UID: \"39595a37-9ed7-429f-a209-954130586e38\") " pod="opendatahub/maas-controller-5b77d68475-n859k" Oct 30 23:42:58.891739 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.891663 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqmhh\" (UniqueName: \"kubernetes.io/projected/39595a37-9ed7-429f-a209-954130586e38-kube-api-access-xqmhh\") pod \"maas-controller-5b77d68475-n859k\" (UID: \"39595a37-9ed7-429f-a209-954130586e38\") " pod="opendatahub/maas-controller-5b77d68475-n859k" Oct 30 23:42:58.891739 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.891688 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39595a37-9ed7-429f-a209-954130586e38-metrics-certs\") pod \"maas-controller-5b77d68475-n859k\" (UID: \"39595a37-9ed7-429f-a209-954130586e38\") " pod="opendatahub/maas-controller-5b77d68475-n859k" Oct 30 23:42:58.992484 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.992461 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39595a37-9ed7-429f-a209-954130586e38-webhook-cert\") pod \"maas-controller-5b77d68475-n859k\" (UID: \"39595a37-9ed7-429f-a209-954130586e38\") " pod="opendatahub/maas-controller-5b77d68475-n859k" Oct 30 23:42:58.992584 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.992500 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqmhh\" (UniqueName: \"kubernetes.io/projected/39595a37-9ed7-429f-a209-954130586e38-kube-api-access-xqmhh\") pod \"maas-controller-5b77d68475-n859k\" (UID: \"39595a37-9ed7-429f-a209-954130586e38\") " pod="opendatahub/maas-controller-5b77d68475-n859k" Oct 30 23:42:58.992584 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.992543 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39595a37-9ed7-429f-a209-954130586e38-metrics-certs\") pod \"maas-controller-5b77d68475-n859k\" (UID: \"39595a37-9ed7-429f-a209-954130586e38\") " pod="opendatahub/maas-controller-5b77d68475-n859k" Oct 30 23:42:58.994794 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.994775 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39595a37-9ed7-429f-a209-954130586e38-webhook-cert\") pod \"maas-controller-5b77d68475-n859k\" (UID: \"39595a37-9ed7-429f-a209-954130586e38\") " pod="opendatahub/maas-controller-5b77d68475-n859k" Oct 30 23:42:58.994862 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:58.994848 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39595a37-9ed7-429f-a209-954130586e38-metrics-certs\") pod \"maas-controller-5b77d68475-n859k\" (UID: \"39595a37-9ed7-429f-a209-954130586e38\") " pod="opendatahub/maas-controller-5b77d68475-n859k" Oct 30 23:42:59.011817 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:59.011799 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqmhh\" (UniqueName: \"kubernetes.io/projected/39595a37-9ed7-429f-a209-954130586e38-kube-api-access-xqmhh\") pod \"maas-controller-5b77d68475-n859k\" (UID: \"39595a37-9ed7-429f-a209-954130586e38\") " pod="opendatahub/maas-controller-5b77d68475-n859k" Oct 30 23:42:59.088623 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:59.088570 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b77d68475-n859k" Oct 30 23:42:59.219819 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:59.219787 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67dcc64f86-46swt" event={"ID":"d05b8e5b-6330-4c62-a2b9-67a69acfbee8","Type":"ContainerStarted","Data":"664819876e70015ed96ce631be8f937cc36a698b5409d55670ad60b651cfa576"} Oct 30 23:42:59.386067 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:42:59.385993 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b77d68475-n859k"] Oct 30 23:42:59.390766 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:42:59.390741 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39595a37_9ed7_429f_a209_954130586e38.slice/crio-531e0163d4e627dfb09f9630a7af6bc601eb22488345f1af0e36fad1b5e2f836 WatchSource:0}: Error finding container 531e0163d4e627dfb09f9630a7af6bc601eb22488345f1af0e36fad1b5e2f836: Status 404 returned error can't find the container with id 531e0163d4e627dfb09f9630a7af6bc601eb22488345f1af0e36fad1b5e2f836 Oct 30 23:43:00.230129 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:00.230055 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b77d68475-n859k" event={"ID":"39595a37-9ed7-429f-a209-954130586e38","Type":"ContainerStarted","Data":"531e0163d4e627dfb09f9630a7af6bc601eb22488345f1af0e36fad1b5e2f836"} Oct 30 23:43:02.241851 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:02.241770 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b77d68475-n859k" event={"ID":"39595a37-9ed7-429f-a209-954130586e38","Type":"ContainerStarted","Data":"9817ed85e2f37643d37e9732d03f95301da69a0319819d285ba8df6db88b6e15"} Oct 30 23:43:02.242290 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:02.241868 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b77d68475-n859k" Oct 30 23:43:02.243332 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:02.243309 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67dcc64f86-46swt" event={"ID":"d05b8e5b-6330-4c62-a2b9-67a69acfbee8","Type":"ContainerStarted","Data":"76bf43c911cc6c71e20c4cd770c9c7b40ef3ad6d03129a8c782d5bed9728463d"} Oct 30 23:43:02.243433 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:02.243395 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67dcc64f86-46swt" Oct 30 23:43:02.283131 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:02.283090 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-5b77d68475-n859k" podStartSLOduration=1.755782245 podStartE2EDuration="4.283078124s" totalImagesPullingTime="2.527295879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:02.281807372 +0000 UTC m=+470.545712947" watchObservedRunningTime="2026-10-30 23:43:02.283078124 +0000 UTC m=+470.546983713" Oct 30 23:43:02.324085 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:02.324027 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-67dcc64f86-46swt" podStartSLOduration=1.636085384 podStartE2EDuration="4.324015113s" totalImagesPullingTime="2.687929729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:02.323286057 +0000 UTC m=+470.587191627" watchObservedRunningTime="2026-10-30 23:43:02.324015113 +0000 UTC m=+470.587920684" Oct 30 23:43:02.530709 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:02.530663 5112 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-142.ec2.internal" podUID="115f903faf6fce7f69241f9f5ad98f46" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 23:43:04.174633 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.174595 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q"] Oct 30 23:43:04.178479 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.178456 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:04.211166 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.211122 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\"" Oct 30 23:43:04.211367 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.211339 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\"" Oct 30 23:43:04.211367 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.211343 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\"" Oct 30 23:43:04.211509 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.211477 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-64t2s\"" Oct 30 23:43:04.212322 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.212301 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q"] Oct 30 23:43:04.341771 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.341730 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b16043f5-2edb-4517-9596-2c023a9f378d-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-md89q\" (UID: \"b16043f5-2edb-4517-9596-2c023a9f378d\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:04.341936 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.341787 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzkpk\" (UniqueName: \"kubernetes.io/projected/b16043f5-2edb-4517-9596-2c023a9f378d-kube-api-access-rzkpk\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-md89q\" (UID: \"b16043f5-2edb-4517-9596-2c023a9f378d\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:04.341936 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.341906 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/b16043f5-2edb-4517-9596-2c023a9f378d-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-md89q\" (UID: \"b16043f5-2edb-4517-9596-2c023a9f378d\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:04.342077 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.342054 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b16043f5-2edb-4517-9596-2c023a9f378d-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-md89q\" (UID: \"b16043f5-2edb-4517-9596-2c023a9f378d\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:04.443108 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.443015 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/b16043f5-2edb-4517-9596-2c023a9f378d-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-md89q\" (UID: \"b16043f5-2edb-4517-9596-2c023a9f378d\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:04.443108 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.443105 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b16043f5-2edb-4517-9596-2c023a9f378d-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-md89q\" (UID: \"b16043f5-2edb-4517-9596-2c023a9f378d\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:04.443331 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.443149 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b16043f5-2edb-4517-9596-2c023a9f378d-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-md89q\" (UID: \"b16043f5-2edb-4517-9596-2c023a9f378d\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:04.443331 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.443167 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzkpk\" (UniqueName: \"kubernetes.io/projected/b16043f5-2edb-4517-9596-2c023a9f378d-kube-api-access-rzkpk\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-md89q\" (UID: \"b16043f5-2edb-4517-9596-2c023a9f378d\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:04.443852 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.443825 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b16043f5-2edb-4517-9596-2c023a9f378d-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-md89q\" (UID: \"b16043f5-2edb-4517-9596-2c023a9f378d\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:04.444050 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.444019 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/b16043f5-2edb-4517-9596-2c023a9f378d-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-md89q\" (UID: \"b16043f5-2edb-4517-9596-2c023a9f378d\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:04.445536 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.445513 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b16043f5-2edb-4517-9596-2c023a9f378d-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-md89q\" (UID: \"b16043f5-2edb-4517-9596-2c023a9f378d\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:04.464215 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.464179 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzkpk\" (UniqueName: \"kubernetes.io/projected/b16043f5-2edb-4517-9596-2c023a9f378d-kube-api-access-rzkpk\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-md89q\" (UID: \"b16043f5-2edb-4517-9596-2c023a9f378d\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:04.495082 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.495061 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:04.797259 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:04.797225 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q"] Oct 30 23:43:04.802129 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:43:04.802098 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb16043f5_2edb_4517_9596_2c023a9f378d.slice/crio-5f343cd0fe192d8f45456501c0663e1d979bb47e66826063256319c919ca8436 WatchSource:0}: Error finding container 5f343cd0fe192d8f45456501c0663e1d979bb47e66826063256319c919ca8436: Status 404 returned error can't find the container with id 5f343cd0fe192d8f45456501c0663e1d979bb47e66826063256319c919ca8436 Oct 30 23:43:05.262443 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:05.262411 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" event={"ID":"b16043f5-2edb-4517-9596-2c023a9f378d","Type":"ContainerStarted","Data":"5f343cd0fe192d8f45456501c0663e1d979bb47e66826063256319c919ca8436"} Oct 30 23:43:13.254217 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:13.254186 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b77d68475-n859k" Oct 30 23:43:13.254684 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:13.254550 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67dcc64f86-46swt" Oct 30 23:43:13.360753 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:13.360715 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67dcc64f86-46swt"] Oct 30 23:43:13.360955 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:13.360915 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-67dcc64f86-46swt" podUID="d05b8e5b-6330-4c62-a2b9-67a69acfbee8" containerName="manager" containerID="cri-o://76bf43c911cc6c71e20c4cd770c9c7b40ef3ad6d03129a8c782d5bed9728463d" gracePeriod=30 Oct 30 23:43:13.631514 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:13.631486 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67dcc64f86-46swt" Oct 30 23:43:13.728581 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:13.728546 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-webhook-cert\" (UniqueName: \"kubernetes.io/secret/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-webhook-cert\") pod \"d05b8e5b-6330-4c62-a2b9-67a69acfbee8\" (UID: \"d05b8e5b-6330-4c62-a2b9-67a69acfbee8\") " Oct 30 23:43:13.728741 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:13.728615 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-metrics-certs\") pod \"d05b8e5b-6330-4c62-a2b9-67a69acfbee8\" (UID: \"d05b8e5b-6330-4c62-a2b9-67a69acfbee8\") " Oct 30 23:43:13.728741 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:13.728720 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-kube-api-access-cfz5c\" (UniqueName: \"kubernetes.io/projected/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-kube-api-access-cfz5c\") pod \"d05b8e5b-6330-4c62-a2b9-67a69acfbee8\" (UID: \"d05b8e5b-6330-4c62-a2b9-67a69acfbee8\") " Oct 30 23:43:13.731095 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:13.731060 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-webhook-cert" pod "d05b8e5b-6330-4c62-a2b9-67a69acfbee8" (UID: "d05b8e5b-6330-4c62-a2b9-67a69acfbee8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:43:13.731264 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:13.731241 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-metrics-certs" pod "d05b8e5b-6330-4c62-a2b9-67a69acfbee8" (UID: "d05b8e5b-6330-4c62-a2b9-67a69acfbee8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:43:13.731349 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:13.731326 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-kube-api-access-cfz5c" pod "d05b8e5b-6330-4c62-a2b9-67a69acfbee8" (UID: "d05b8e5b-6330-4c62-a2b9-67a69acfbee8"). InnerVolumeSpecName "kube-api-access-cfz5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:43:13.830155 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:13.830075 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfz5c\" (UniqueName: \"kubernetes.io/projected/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-kube-api-access-cfz5c\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:43:13.830155 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:13.830111 5112 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-webhook-cert\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:43:13.830155 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:13.830126 5112 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05b8e5b-6330-4c62-a2b9-67a69acfbee8-metrics-certs\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:43:14.323353 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:14.323319 5112 generic.go:356] "Generic (PLEG): container finished" podID="d05b8e5b-6330-4c62-a2b9-67a69acfbee8" containerID="76bf43c911cc6c71e20c4cd770c9c7b40ef3ad6d03129a8c782d5bed9728463d" exitCode=0 Oct 30 23:43:14.323860 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:14.323380 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67dcc64f86-46swt" Oct 30 23:43:14.323860 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:14.323489 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67dcc64f86-46swt" event={"ID":"d05b8e5b-6330-4c62-a2b9-67a69acfbee8","Type":"ContainerDied","Data":"76bf43c911cc6c71e20c4cd770c9c7b40ef3ad6d03129a8c782d5bed9728463d"} Oct 30 23:43:14.323860 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:14.323549 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67dcc64f86-46swt" event={"ID":"d05b8e5b-6330-4c62-a2b9-67a69acfbee8","Type":"ContainerDied","Data":"664819876e70015ed96ce631be8f937cc36a698b5409d55670ad60b651cfa576"} Oct 30 23:43:14.323860 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:14.323580 5112 scope.go:122] "RemoveContainer" containerID="76bf43c911cc6c71e20c4cd770c9c7b40ef3ad6d03129a8c782d5bed9728463d" Oct 30 23:43:14.334077 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:14.334032 5112 scope.go:122] "RemoveContainer" containerID="76bf43c911cc6c71e20c4cd770c9c7b40ef3ad6d03129a8c782d5bed9728463d" Oct 30 23:43:14.334417 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:43:14.334393 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76bf43c911cc6c71e20c4cd770c9c7b40ef3ad6d03129a8c782d5bed9728463d\": container with ID starting with 76bf43c911cc6c71e20c4cd770c9c7b40ef3ad6d03129a8c782d5bed9728463d not found: ID does not exist" containerID="76bf43c911cc6c71e20c4cd770c9c7b40ef3ad6d03129a8c782d5bed9728463d" Oct 30 23:43:14.334518 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:14.334431 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76bf43c911cc6c71e20c4cd770c9c7b40ef3ad6d03129a8c782d5bed9728463d"} err="failed to get container status \"76bf43c911cc6c71e20c4cd770c9c7b40ef3ad6d03129a8c782d5bed9728463d\": rpc error: code = NotFound desc = could not find container \"76bf43c911cc6c71e20c4cd770c9c7b40ef3ad6d03129a8c782d5bed9728463d\": container with ID starting with 76bf43c911cc6c71e20c4cd770c9c7b40ef3ad6d03129a8c782d5bed9728463d not found: ID does not exist" Oct 30 23:43:14.382123 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:14.382097 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67dcc64f86-46swt"] Oct 30 23:43:14.392944 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:14.392911 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-67dcc64f86-46swt"] Oct 30 23:43:15.874928 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:15.874903 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d05b8e5b-6330-4c62-a2b9-67a69acfbee8" path="/var/lib/kubelet/pods/d05b8e5b-6330-4c62-a2b9-67a69acfbee8/volumes" Oct 30 23:43:16.340648 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:16.340607 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" event={"ID":"b16043f5-2edb-4517-9596-2c023a9f378d","Type":"ContainerStarted","Data":"1d6f9c52a23f7d02a024be592dd56e5ca8f1834d89ad85bc0611b4ef8a294765"} Oct 30 23:43:16.340849 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:16.340759 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:16.388392 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:16.388336 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" podStartSLOduration=1.831122192 podStartE2EDuration="12.388318889s" totalImagesPullingTime="10.557196697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:16.386796523 +0000 UTC m=+484.650702095" watchObservedRunningTime="2026-10-30 23:43:16.388318889 +0000 UTC m=+484.652224462" Oct 30 23:43:22.976416 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:43:22.976335 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:43:27.350859 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:27.350822 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-md89q" Oct 30 23:43:36.566606 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:36.566569 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd"] Oct 30 23:43:36.567110 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:36.567004 5112 cpu_manager.go:414] "containerMap: removing container" podUID="d05b8e5b-6330-4c62-a2b9-67a69acfbee8" containerName="manager" Oct 30 23:43:36.567110 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:36.567016 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d05b8e5b-6330-4c62-a2b9-67a69acfbee8" containerName="manager" Oct 30 23:43:36.567110 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:36.567100 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="d05b8e5b-6330-4c62-a2b9-67a69acfbee8" containerName="manager" Oct 30 23:43:36.984165 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:36.984091 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd"] Oct 30 23:43:36.984365 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:36.984175 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:36.999255 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:36.999235 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:43:37.010522 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.010501 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:43:37.010725 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.010706 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Oct 30 23:43:37.010725 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.010713 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-626qd\"" Oct 30 23:43:37.010862 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.010744 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Oct 30 23:43:37.107350 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.107322 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94f4014b-70e5-4ea1-8810-ea218bdcb92e-maas-api-tls\") pod \"maas-api-75c55b99b5-f9hdd\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:37.107350 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.107349 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssfcv\" (UniqueName: \"kubernetes.io/projected/94f4014b-70e5-4ea1-8810-ea218bdcb92e-kube-api-access-ssfcv\") pod \"maas-api-75c55b99b5-f9hdd\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:37.107643 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.107621 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94f4014b-70e5-4ea1-8810-ea218bdcb92e-metrics-certs\") pod \"maas-api-75c55b99b5-f9hdd\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:37.107732 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.107679 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94f4014b-70e5-4ea1-8810-ea218bdcb92e-openshift-service-ca\") pod \"maas-api-75c55b99b5-f9hdd\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:37.207966 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.207943 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94f4014b-70e5-4ea1-8810-ea218bdcb92e-metrics-certs\") pod \"maas-api-75c55b99b5-f9hdd\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:37.208083 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.207974 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94f4014b-70e5-4ea1-8810-ea218bdcb92e-openshift-service-ca\") pod \"maas-api-75c55b99b5-f9hdd\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:37.208083 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.208025 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94f4014b-70e5-4ea1-8810-ea218bdcb92e-maas-api-tls\") pod \"maas-api-75c55b99b5-f9hdd\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:37.208083 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.208060 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssfcv\" (UniqueName: \"kubernetes.io/projected/94f4014b-70e5-4ea1-8810-ea218bdcb92e-kube-api-access-ssfcv\") pod \"maas-api-75c55b99b5-f9hdd\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:37.208734 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.208711 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94f4014b-70e5-4ea1-8810-ea218bdcb92e-openshift-service-ca\") pod \"maas-api-75c55b99b5-f9hdd\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:37.210399 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.210377 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94f4014b-70e5-4ea1-8810-ea218bdcb92e-metrics-certs\") pod \"maas-api-75c55b99b5-f9hdd\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:37.210490 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.210427 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94f4014b-70e5-4ea1-8810-ea218bdcb92e-maas-api-tls\") pod \"maas-api-75c55b99b5-f9hdd\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:37.227201 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.227184 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssfcv\" (UniqueName: \"kubernetes.io/projected/94f4014b-70e5-4ea1-8810-ea218bdcb92e-kube-api-access-ssfcv\") pod \"maas-api-75c55b99b5-f9hdd\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:37.321425 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.321396 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:37.640326 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:37.640261 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd"] Oct 30 23:43:37.643353 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:43:37.643327 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f4014b_70e5_4ea1_8810_ea218bdcb92e.slice/crio-c1e513be7dd45e36c2c199d175fef54fc341666d03c73fa53a44a8782f5e29ea WatchSource:0}: Error finding container c1e513be7dd45e36c2c199d175fef54fc341666d03c73fa53a44a8782f5e29ea: Status 404 returned error can't find the container with id c1e513be7dd45e36c2c199d175fef54fc341666d03c73fa53a44a8782f5e29ea Oct 30 23:43:38.450780 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:38.450740 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" event={"ID":"94f4014b-70e5-4ea1-8810-ea218bdcb92e","Type":"ContainerStarted","Data":"c1e513be7dd45e36c2c199d175fef54fc341666d03c73fa53a44a8782f5e29ea"} Oct 30 23:43:39.460728 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:39.460688 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" event={"ID":"94f4014b-70e5-4ea1-8810-ea218bdcb92e","Type":"ContainerStarted","Data":"1d254e0d0100fbc92551a436f44374bae120def7db04e60b0dddfadef7445637"} Oct 30 23:43:39.461185 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:39.460831 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:39.512650 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:39.512588 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" podStartSLOduration=1.8543313129999999 podStartE2EDuration="3.512569918s" totalImagesPullingTime="1.658238605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:39.510106005 +0000 UTC m=+507.774011577" watchObservedRunningTime="2026-10-30 23:43:39.512569918 +0000 UTC m=+507.776475492" Oct 30 23:43:45.470885 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:45.470850 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:46.631474 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:46.631443 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-kzj2p"] Oct 30 23:43:46.635310 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:46.635290 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-kzj2p" Oct 30 23:43:46.654747 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:46.654724 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-kzj2p"] Oct 30 23:43:46.680526 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:46.680493 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppw4s\" (UniqueName: \"kubernetes.io/projected/4e235a28-6e88-477c-a8d9-0d39a4e0814b-kube-api-access-ppw4s\") pod \"authorino-6f6944bcdd-kzj2p\" (UID: \"4e235a28-6e88-477c-a8d9-0d39a4e0814b\") " pod="kuadrant-system/authorino-6f6944bcdd-kzj2p" Oct 30 23:43:46.781810 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:46.781789 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppw4s\" (UniqueName: \"kubernetes.io/projected/4e235a28-6e88-477c-a8d9-0d39a4e0814b-kube-api-access-ppw4s\") pod \"authorino-6f6944bcdd-kzj2p\" (UID: \"4e235a28-6e88-477c-a8d9-0d39a4e0814b\") " pod="kuadrant-system/authorino-6f6944bcdd-kzj2p" Oct 30 23:43:46.807457 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:46.807436 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppw4s\" (UniqueName: \"kubernetes.io/projected/4e235a28-6e88-477c-a8d9-0d39a4e0814b-kube-api-access-ppw4s\") pod \"authorino-6f6944bcdd-kzj2p\" (UID: \"4e235a28-6e88-477c-a8d9-0d39a4e0814b\") " pod="kuadrant-system/authorino-6f6944bcdd-kzj2p" Oct 30 23:43:46.829624 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:46.829601 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-kzj2p"] Oct 30 23:43:46.829767 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:46.829755 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-kzj2p" Oct 30 23:43:47.046467 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:47.046430 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68c5f4cc5-jnx4r"] Oct 30 23:43:47.051383 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:47.051364 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" Oct 30 23:43:47.071369 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:47.071350 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68c5f4cc5-jnx4r"] Oct 30 23:43:47.080533 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:47.080510 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Oct 30 23:43:47.132903 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:47.132845 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-kzj2p"] Oct 30 23:43:47.137320 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:43:47.137294 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e235a28_6e88_477c_a8d9_0d39a4e0814b.slice/crio-2a3e6c611af0d4aa9d459ebc3ab2e9ca578a99706a3351ea64e5c2c3e1dffd7d WatchSource:0}: Error finding container 2a3e6c611af0d4aa9d459ebc3ab2e9ca578a99706a3351ea64e5c2c3e1dffd7d: Status 404 returned error can't find the container with id 2a3e6c611af0d4aa9d459ebc3ab2e9ca578a99706a3351ea64e5c2c3e1dffd7d Oct 30 23:43:47.184375 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:47.184342 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w6mp\" (UniqueName: \"kubernetes.io/projected/84097ef4-f84f-430c-be6d-56dac7278634-kube-api-access-9w6mp\") pod \"authorino-68c5f4cc5-jnx4r\" (UID: \"84097ef4-f84f-430c-be6d-56dac7278634\") " pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" Oct 30 23:43:47.184500 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:47.184479 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84097ef4-f84f-430c-be6d-56dac7278634-tls-cert\") pod \"authorino-68c5f4cc5-jnx4r\" (UID: \"84097ef4-f84f-430c-be6d-56dac7278634\") " pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" Oct 30 23:43:47.284826 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:47.284797 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84097ef4-f84f-430c-be6d-56dac7278634-tls-cert\") pod \"authorino-68c5f4cc5-jnx4r\" (UID: \"84097ef4-f84f-430c-be6d-56dac7278634\") " pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" Oct 30 23:43:47.284927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:47.284843 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w6mp\" (UniqueName: \"kubernetes.io/projected/84097ef4-f84f-430c-be6d-56dac7278634-kube-api-access-9w6mp\") pod \"authorino-68c5f4cc5-jnx4r\" (UID: \"84097ef4-f84f-430c-be6d-56dac7278634\") " pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" Oct 30 23:43:47.287309 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:47.287289 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84097ef4-f84f-430c-be6d-56dac7278634-tls-cert\") pod \"authorino-68c5f4cc5-jnx4r\" (UID: \"84097ef4-f84f-430c-be6d-56dac7278634\") " pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" Oct 30 23:43:47.305185 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:47.305162 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w6mp\" (UniqueName: \"kubernetes.io/projected/84097ef4-f84f-430c-be6d-56dac7278634-kube-api-access-9w6mp\") pod \"authorino-68c5f4cc5-jnx4r\" (UID: \"84097ef4-f84f-430c-be6d-56dac7278634\") " pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" Oct 30 23:43:47.363179 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:47.363159 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" Oct 30 23:43:47.501021 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:47.500982 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-kzj2p" event={"ID":"4e235a28-6e88-477c-a8d9-0d39a4e0814b","Type":"ContainerStarted","Data":"2a3e6c611af0d4aa9d459ebc3ab2e9ca578a99706a3351ea64e5c2c3e1dffd7d"} Oct 30 23:43:47.669762 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:47.669694 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68c5f4cc5-jnx4r"] Oct 30 23:43:47.674298 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:43:47.674269 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84097ef4_f84f_430c_be6d_56dac7278634.slice/crio-d12d9cdffe0ef03f6debc865c54fcd631e3e8bbe95ed02193429ad20c9b2232d WatchSource:0}: Error finding container d12d9cdffe0ef03f6debc865c54fcd631e3e8bbe95ed02193429ad20c9b2232d: Status 404 returned error can't find the container with id d12d9cdffe0ef03f6debc865c54fcd631e3e8bbe95ed02193429ad20c9b2232d Oct 30 23:43:48.513740 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:48.513683 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" event={"ID":"84097ef4-f84f-430c-be6d-56dac7278634","Type":"ContainerStarted","Data":"3bf796bab1ca49b119f5d3238cb2d0d3c026d77b6d60283d8357043d601c73bb"} Oct 30 23:43:48.513921 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:48.513753 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" event={"ID":"84097ef4-f84f-430c-be6d-56dac7278634","Type":"ContainerStarted","Data":"d12d9cdffe0ef03f6debc865c54fcd631e3e8bbe95ed02193429ad20c9b2232d"} Oct 30 23:43:48.516162 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:48.516123 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-kzj2p" event={"ID":"4e235a28-6e88-477c-a8d9-0d39a4e0814b","Type":"ContainerStarted","Data":"9274a206865daebef3ddf1f0f0ce427fcd8642f6c11306716c26b3a594b5b9cc"} Oct 30 23:43:48.516304 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:48.516239 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-kzj2p" podUID="4e235a28-6e88-477c-a8d9-0d39a4e0814b" containerName="authorino" containerID="cri-o://9274a206865daebef3ddf1f0f0ce427fcd8642f6c11306716c26b3a594b5b9cc" gracePeriod=30 Oct 30 23:43:48.565466 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:48.565413 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" podStartSLOduration=1.245831433 podStartE2EDuration="1.565396415s" totalImagesPullingTime="319.564982ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:48.563648327 +0000 UTC m=+516.827553901" watchObservedRunningTime="2026-10-30 23:43:48.565396415 +0000 UTC m=+516.829301987" Oct 30 23:43:48.627907 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:48.627082 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-swwjn"] Oct 30 23:43:48.627907 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:48.627345 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-swwjn" podUID="2447f7a4-82a0-4701-8601-0f63039071b0" containerName="authorino" containerID="cri-o://1c9bd74f5043baeb0119e4bffbfb1e78494c06772706f3eda86e44b38dad4ec3" gracePeriod=30 Oct 30 23:43:48.629348 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:48.629286 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-kzj2p" podStartSLOduration=1.9956151069999999 podStartE2EDuration="2.629268853s" totalImagesPullingTime="633.653746ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:48.621534391 +0000 UTC m=+516.885439963" watchObservedRunningTime="2026-10-30 23:43:48.629268853 +0000 UTC m=+516.893174427" Oct 30 23:43:48.808896 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:48.808669 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-kzj2p" Oct 30 23:43:48.903986 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:48.903805 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e235a28-6e88-477c-a8d9-0d39a4e0814b-kube-api-access-ppw4s\" (UniqueName: \"kubernetes.io/projected/4e235a28-6e88-477c-a8d9-0d39a4e0814b-kube-api-access-ppw4s\") pod \"4e235a28-6e88-477c-a8d9-0d39a4e0814b\" (UID: \"4e235a28-6e88-477c-a8d9-0d39a4e0814b\") " Oct 30 23:43:48.905880 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:48.905857 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e235a28-6e88-477c-a8d9-0d39a4e0814b-kube-api-access-ppw4s" pod "4e235a28-6e88-477c-a8d9-0d39a4e0814b" (UID: "4e235a28-6e88-477c-a8d9-0d39a4e0814b"). InnerVolumeSpecName "kube-api-access-ppw4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:43:48.920953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:48.920934 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-swwjn" Oct 30 23:43:49.005026 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.004996 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2447f7a4-82a0-4701-8601-0f63039071b0-kube-api-access-2tqct\" (UniqueName: \"kubernetes.io/projected/2447f7a4-82a0-4701-8601-0f63039071b0-kube-api-access-2tqct\") pod \"2447f7a4-82a0-4701-8601-0f63039071b0\" (UID: \"2447f7a4-82a0-4701-8601-0f63039071b0\") " Oct 30 23:43:49.005257 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.005243 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppw4s\" (UniqueName: \"kubernetes.io/projected/4e235a28-6e88-477c-a8d9-0d39a4e0814b-kube-api-access-ppw4s\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:43:49.007333 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.007305 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2447f7a4-82a0-4701-8601-0f63039071b0-kube-api-access-2tqct" pod "2447f7a4-82a0-4701-8601-0f63039071b0" (UID: "2447f7a4-82a0-4701-8601-0f63039071b0"). InnerVolumeSpecName "kube-api-access-2tqct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:43:49.105782 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.105728 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tqct\" (UniqueName: \"kubernetes.io/projected/2447f7a4-82a0-4701-8601-0f63039071b0-kube-api-access-2tqct\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:43:49.522555 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.522527 5112 generic.go:356] "Generic (PLEG): container finished" podID="4e235a28-6e88-477c-a8d9-0d39a4e0814b" containerID="9274a206865daebef3ddf1f0f0ce427fcd8642f6c11306716c26b3a594b5b9cc" exitCode=0 Oct 30 23:43:49.522677 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.522566 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-kzj2p" Oct 30 23:43:49.522677 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.522612 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-kzj2p" event={"ID":"4e235a28-6e88-477c-a8d9-0d39a4e0814b","Type":"ContainerDied","Data":"9274a206865daebef3ddf1f0f0ce427fcd8642f6c11306716c26b3a594b5b9cc"} Oct 30 23:43:49.522677 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.522651 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-kzj2p" event={"ID":"4e235a28-6e88-477c-a8d9-0d39a4e0814b","Type":"ContainerDied","Data":"2a3e6c611af0d4aa9d459ebc3ab2e9ca578a99706a3351ea64e5c2c3e1dffd7d"} Oct 30 23:43:49.522677 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.522669 5112 scope.go:122] "RemoveContainer" containerID="9274a206865daebef3ddf1f0f0ce427fcd8642f6c11306716c26b3a594b5b9cc" Oct 30 23:43:49.524099 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.524072 5112 generic.go:356] "Generic (PLEG): container finished" podID="2447f7a4-82a0-4701-8601-0f63039071b0" containerID="1c9bd74f5043baeb0119e4bffbfb1e78494c06772706f3eda86e44b38dad4ec3" exitCode=0 Oct 30 23:43:49.524212 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.524112 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-swwjn" Oct 30 23:43:49.524212 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.524162 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-swwjn" event={"ID":"2447f7a4-82a0-4701-8601-0f63039071b0","Type":"ContainerDied","Data":"1c9bd74f5043baeb0119e4bffbfb1e78494c06772706f3eda86e44b38dad4ec3"} Oct 30 23:43:49.524212 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.524196 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-swwjn" event={"ID":"2447f7a4-82a0-4701-8601-0f63039071b0","Type":"ContainerDied","Data":"41cc9f3f3fa01a32dd9a395aa235a53b718ed7119a077a4531150e167f0e6140"} Oct 30 23:43:49.531496 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.531475 5112 scope.go:122] "RemoveContainer" containerID="9274a206865daebef3ddf1f0f0ce427fcd8642f6c11306716c26b3a594b5b9cc" Oct 30 23:43:49.531825 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:43:49.531800 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9274a206865daebef3ddf1f0f0ce427fcd8642f6c11306716c26b3a594b5b9cc\": container with ID starting with 9274a206865daebef3ddf1f0f0ce427fcd8642f6c11306716c26b3a594b5b9cc not found: ID does not exist" containerID="9274a206865daebef3ddf1f0f0ce427fcd8642f6c11306716c26b3a594b5b9cc" Oct 30 23:43:49.531916 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.531828 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9274a206865daebef3ddf1f0f0ce427fcd8642f6c11306716c26b3a594b5b9cc"} err="failed to get container status \"9274a206865daebef3ddf1f0f0ce427fcd8642f6c11306716c26b3a594b5b9cc\": rpc error: code = NotFound desc = could not find container \"9274a206865daebef3ddf1f0f0ce427fcd8642f6c11306716c26b3a594b5b9cc\": container with ID starting with 9274a206865daebef3ddf1f0f0ce427fcd8642f6c11306716c26b3a594b5b9cc not found: ID does not exist" Oct 30 23:43:49.531916 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.531847 5112 scope.go:122] "RemoveContainer" containerID="1c9bd74f5043baeb0119e4bffbfb1e78494c06772706f3eda86e44b38dad4ec3" Oct 30 23:43:49.539988 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.539975 5112 scope.go:122] "RemoveContainer" containerID="1c9bd74f5043baeb0119e4bffbfb1e78494c06772706f3eda86e44b38dad4ec3" Oct 30 23:43:49.540258 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:43:49.540238 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c9bd74f5043baeb0119e4bffbfb1e78494c06772706f3eda86e44b38dad4ec3\": container with ID starting with 1c9bd74f5043baeb0119e4bffbfb1e78494c06772706f3eda86e44b38dad4ec3 not found: ID does not exist" containerID="1c9bd74f5043baeb0119e4bffbfb1e78494c06772706f3eda86e44b38dad4ec3" Oct 30 23:43:49.540326 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.540266 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c9bd74f5043baeb0119e4bffbfb1e78494c06772706f3eda86e44b38dad4ec3"} err="failed to get container status \"1c9bd74f5043baeb0119e4bffbfb1e78494c06772706f3eda86e44b38dad4ec3\": rpc error: code = NotFound desc = could not find container \"1c9bd74f5043baeb0119e4bffbfb1e78494c06772706f3eda86e44b38dad4ec3\": container with ID starting with 1c9bd74f5043baeb0119e4bffbfb1e78494c06772706f3eda86e44b38dad4ec3 not found: ID does not exist" Oct 30 23:43:49.573616 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.573580 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-kzj2p"] Oct 30 23:43:49.579251 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.579233 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-kzj2p"] Oct 30 23:43:49.621284 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.621257 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-swwjn"] Oct 30 23:43:49.630102 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.630081 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-swwjn"] Oct 30 23:43:49.874586 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.874524 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2447f7a4-82a0-4701-8601-0f63039071b0" path="/var/lib/kubelet/pods/2447f7a4-82a0-4701-8601-0f63039071b0/volumes" Oct 30 23:43:49.874897 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:49.874816 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4e235a28-6e88-477c-a8d9-0d39a4e0814b" path="/var/lib/kubelet/pods/4e235a28-6e88-477c-a8d9-0d39a4e0814b/volumes" Oct 30 23:43:52.977367 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:43:52.977322 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:43:56.039640 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.039604 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd"] Oct 30 23:43:56.040305 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.039812 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" podUID="94f4014b-70e5-4ea1-8810-ea218bdcb92e" containerName="maas-api" containerID="cri-o://1d254e0d0100fbc92551a436f44374bae120def7db04e60b0dddfadef7445637" gracePeriod=30 Oct 30 23:43:56.289254 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.289229 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:56.356767 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.356705 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/94f4014b-70e5-4ea1-8810-ea218bdcb92e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94f4014b-70e5-4ea1-8810-ea218bdcb92e-maas-api-tls\") pod \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " Oct 30 23:43:56.356767 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.356744 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/94f4014b-70e5-4ea1-8810-ea218bdcb92e-kube-api-access-ssfcv\" (UniqueName: \"kubernetes.io/projected/94f4014b-70e5-4ea1-8810-ea218bdcb92e-kube-api-access-ssfcv\") pod \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " Oct 30 23:43:56.356948 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.356820 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/94f4014b-70e5-4ea1-8810-ea218bdcb92e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94f4014b-70e5-4ea1-8810-ea218bdcb92e-openshift-service-ca\") pod \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " Oct 30 23:43:56.356948 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.356838 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/94f4014b-70e5-4ea1-8810-ea218bdcb92e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/94f4014b-70e5-4ea1-8810-ea218bdcb92e-metrics-certs\") pod \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\" (UID: \"94f4014b-70e5-4ea1-8810-ea218bdcb92e\") " Oct 30 23:43:56.357214 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.357184 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94f4014b-70e5-4ea1-8810-ea218bdcb92e-openshift-service-ca" pod "94f4014b-70e5-4ea1-8810-ea218bdcb92e" (UID: "94f4014b-70e5-4ea1-8810-ea218bdcb92e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:43:56.358989 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.358963 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94f4014b-70e5-4ea1-8810-ea218bdcb92e-kube-api-access-ssfcv" pod "94f4014b-70e5-4ea1-8810-ea218bdcb92e" (UID: "94f4014b-70e5-4ea1-8810-ea218bdcb92e"). InnerVolumeSpecName "kube-api-access-ssfcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:43:56.359149 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.358963 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94f4014b-70e5-4ea1-8810-ea218bdcb92e-metrics-certs" pod "94f4014b-70e5-4ea1-8810-ea218bdcb92e" (UID: "94f4014b-70e5-4ea1-8810-ea218bdcb92e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:43:56.359149 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.359019 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94f4014b-70e5-4ea1-8810-ea218bdcb92e-maas-api-tls" pod "94f4014b-70e5-4ea1-8810-ea218bdcb92e" (UID: "94f4014b-70e5-4ea1-8810-ea218bdcb92e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:43:56.458297 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.458275 5112 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94f4014b-70e5-4ea1-8810-ea218bdcb92e-openshift-service-ca\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:43:56.458297 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.458298 5112 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94f4014b-70e5-4ea1-8810-ea218bdcb92e-metrics-certs\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:43:56.458420 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.458308 5112 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94f4014b-70e5-4ea1-8810-ea218bdcb92e-maas-api-tls\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:43:56.458420 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.458316 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssfcv\" (UniqueName: \"kubernetes.io/projected/94f4014b-70e5-4ea1-8810-ea218bdcb92e-kube-api-access-ssfcv\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:43:56.564331 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.564305 5112 generic.go:356] "Generic (PLEG): container finished" podID="94f4014b-70e5-4ea1-8810-ea218bdcb92e" containerID="1d254e0d0100fbc92551a436f44374bae120def7db04e60b0dddfadef7445637" exitCode=0 Oct 30 23:43:56.564424 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.564353 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" Oct 30 23:43:56.564424 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.564390 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" event={"ID":"94f4014b-70e5-4ea1-8810-ea218bdcb92e","Type":"ContainerDied","Data":"1d254e0d0100fbc92551a436f44374bae120def7db04e60b0dddfadef7445637"} Oct 30 23:43:56.564502 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.564445 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd" event={"ID":"94f4014b-70e5-4ea1-8810-ea218bdcb92e","Type":"ContainerDied","Data":"c1e513be7dd45e36c2c199d175fef54fc341666d03c73fa53a44a8782f5e29ea"} Oct 30 23:43:56.564502 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.564458 5112 scope.go:122] "RemoveContainer" containerID="1d254e0d0100fbc92551a436f44374bae120def7db04e60b0dddfadef7445637" Oct 30 23:43:56.576855 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.576839 5112 scope.go:122] "RemoveContainer" containerID="1d254e0d0100fbc92551a436f44374bae120def7db04e60b0dddfadef7445637" Oct 30 23:43:56.577196 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:43:56.577179 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d254e0d0100fbc92551a436f44374bae120def7db04e60b0dddfadef7445637\": container with ID starting with 1d254e0d0100fbc92551a436f44374bae120def7db04e60b0dddfadef7445637 not found: ID does not exist" containerID="1d254e0d0100fbc92551a436f44374bae120def7db04e60b0dddfadef7445637" Oct 30 23:43:56.577268 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.577203 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d254e0d0100fbc92551a436f44374bae120def7db04e60b0dddfadef7445637"} err="failed to get container status \"1d254e0d0100fbc92551a436f44374bae120def7db04e60b0dddfadef7445637\": rpc error: code = NotFound desc = could not find container \"1d254e0d0100fbc92551a436f44374bae120def7db04e60b0dddfadef7445637\": container with ID starting with 1d254e0d0100fbc92551a436f44374bae120def7db04e60b0dddfadef7445637 not found: ID does not exist" Oct 30 23:43:56.614853 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.614802 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd"] Oct 30 23:43:56.617115 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:56.617097 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-75c55b99b5-f9hdd"] Oct 30 23:43:57.875172 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:43:57.875139 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="94f4014b-70e5-4ea1-8810-ea218bdcb92e" path="/var/lib/kubelet/pods/94f4014b-70e5-4ea1-8810-ea218bdcb92e/volumes" Oct 30 23:44:21.859464 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.859425 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d8bfd975-tmbfp"] Oct 30 23:44:21.859974 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.859942 5112 cpu_manager.go:414] "containerMap: removing container" podUID="2447f7a4-82a0-4701-8601-0f63039071b0" containerName="authorino" Oct 30 23:44:21.859974 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.859965 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2447f7a4-82a0-4701-8601-0f63039071b0" containerName="authorino" Oct 30 23:44:21.859974 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.859978 5112 cpu_manager.go:414] "containerMap: removing container" podUID="94f4014b-70e5-4ea1-8810-ea218bdcb92e" containerName="maas-api" Oct 30 23:44:21.859974 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.859983 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="94f4014b-70e5-4ea1-8810-ea218bdcb92e" containerName="maas-api" Oct 30 23:44:21.860250 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.859999 5112 cpu_manager.go:414] "containerMap: removing container" podUID="4e235a28-6e88-477c-a8d9-0d39a4e0814b" containerName="authorino" Oct 30 23:44:21.860250 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.860006 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4e235a28-6e88-477c-a8d9-0d39a4e0814b" containerName="authorino" Oct 30 23:44:21.860250 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.860098 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="2447f7a4-82a0-4701-8601-0f63039071b0" containerName="authorino" Oct 30 23:44:21.860250 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.860108 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="94f4014b-70e5-4ea1-8810-ea218bdcb92e" containerName="maas-api" Oct 30 23:44:21.860250 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.860116 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="4e235a28-6e88-477c-a8d9-0d39a4e0814b" containerName="authorino" Oct 30 23:44:21.865401 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.865379 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d8bfd975-tmbfp" Oct 30 23:44:21.878841 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.878814 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d8bfd975-tmbfp"] Oct 30 23:44:21.888174 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.888148 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Oct 30 23:44:21.957485 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.957463 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22ddh\" (UniqueName: \"kubernetes.io/projected/ca9a3e7d-b296-47ed-883f-a7e014e93eec-kube-api-access-22ddh\") pod \"authorino-6d8bfd975-tmbfp\" (UID: \"ca9a3e7d-b296-47ed-883f-a7e014e93eec\") " pod="kuadrant-system/authorino-6d8bfd975-tmbfp" Oct 30 23:44:21.957584 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.957505 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ca9a3e7d-b296-47ed-883f-a7e014e93eec-tls-cert\") pod \"authorino-6d8bfd975-tmbfp\" (UID: \"ca9a3e7d-b296-47ed-883f-a7e014e93eec\") " pod="kuadrant-system/authorino-6d8bfd975-tmbfp" Oct 30 23:44:21.957584 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:21.957531 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ca9a3e7d-b296-47ed-883f-a7e014e93eec-oidc-ca\") pod \"authorino-6d8bfd975-tmbfp\" (UID: \"ca9a3e7d-b296-47ed-883f-a7e014e93eec\") " pod="kuadrant-system/authorino-6d8bfd975-tmbfp" Oct 30 23:44:22.058919 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:22.058892 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22ddh\" (UniqueName: \"kubernetes.io/projected/ca9a3e7d-b296-47ed-883f-a7e014e93eec-kube-api-access-22ddh\") pod \"authorino-6d8bfd975-tmbfp\" (UID: \"ca9a3e7d-b296-47ed-883f-a7e014e93eec\") " pod="kuadrant-system/authorino-6d8bfd975-tmbfp" Oct 30 23:44:22.059008 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:22.058936 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ca9a3e7d-b296-47ed-883f-a7e014e93eec-tls-cert\") pod \"authorino-6d8bfd975-tmbfp\" (UID: \"ca9a3e7d-b296-47ed-883f-a7e014e93eec\") " pod="kuadrant-system/authorino-6d8bfd975-tmbfp" Oct 30 23:44:22.059008 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:22.058954 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ca9a3e7d-b296-47ed-883f-a7e014e93eec-oidc-ca\") pod \"authorino-6d8bfd975-tmbfp\" (UID: \"ca9a3e7d-b296-47ed-883f-a7e014e93eec\") " pod="kuadrant-system/authorino-6d8bfd975-tmbfp" Oct 30 23:44:22.059635 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:22.059613 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ca9a3e7d-b296-47ed-883f-a7e014e93eec-oidc-ca\") pod \"authorino-6d8bfd975-tmbfp\" (UID: \"ca9a3e7d-b296-47ed-883f-a7e014e93eec\") " pod="kuadrant-system/authorino-6d8bfd975-tmbfp" Oct 30 23:44:22.061456 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:22.061432 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ca9a3e7d-b296-47ed-883f-a7e014e93eec-tls-cert\") pod \"authorino-6d8bfd975-tmbfp\" (UID: \"ca9a3e7d-b296-47ed-883f-a7e014e93eec\") " pod="kuadrant-system/authorino-6d8bfd975-tmbfp" Oct 30 23:44:22.077214 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:22.077193 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22ddh\" (UniqueName: \"kubernetes.io/projected/ca9a3e7d-b296-47ed-883f-a7e014e93eec-kube-api-access-22ddh\") pod \"authorino-6d8bfd975-tmbfp\" (UID: \"ca9a3e7d-b296-47ed-883f-a7e014e93eec\") " pod="kuadrant-system/authorino-6d8bfd975-tmbfp" Oct 30 23:44:22.177846 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:22.177797 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d8bfd975-tmbfp" Oct 30 23:44:22.468105 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:22.468022 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d8bfd975-tmbfp"] Oct 30 23:44:22.471967 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:44:22.471940 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca9a3e7d_b296_47ed_883f_a7e014e93eec.slice/crio-964ad65d71dee8b362b71dc5e5f279053a05782a092b73988c13b97568fdf26f WatchSource:0}: Error finding container 964ad65d71dee8b362b71dc5e5f279053a05782a092b73988c13b97568fdf26f: Status 404 returned error can't find the container with id 964ad65d71dee8b362b71dc5e5f279053a05782a092b73988c13b97568fdf26f Oct 30 23:44:22.703479 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:22.703451 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d8bfd975-tmbfp" event={"ID":"ca9a3e7d-b296-47ed-883f-a7e014e93eec","Type":"ContainerStarted","Data":"964ad65d71dee8b362b71dc5e5f279053a05782a092b73988c13b97568fdf26f"} Oct 30 23:44:22.974311 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:44:22.974277 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:44:23.710608 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:23.710569 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d8bfd975-tmbfp" event={"ID":"ca9a3e7d-b296-47ed-883f-a7e014e93eec","Type":"ContainerStarted","Data":"df4ee3230ac8fa66b8f271f9a38f887aa142a66ee452d3415087c693db40a1a5"} Oct 30 23:44:23.749245 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:23.749200 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6d8bfd975-tmbfp" podStartSLOduration=2.385894252 podStartE2EDuration="2.749188544s" totalImagesPullingTime="363.294292ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:23.747559967 +0000 UTC m=+552.011465517" watchObservedRunningTime="2026-10-30 23:44:23.749188544 +0000 UTC m=+552.013094163" Oct 30 23:44:23.773502 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:23.773467 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68c5f4cc5-jnx4r"] Oct 30 23:44:23.773672 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:23.773652 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" podUID="84097ef4-f84f-430c-be6d-56dac7278634" containerName="authorino" containerID="cri-o://3bf796bab1ca49b119f5d3238cb2d0d3c026d77b6d60283d8357043d601c73bb" gracePeriod=30 Oct 30 23:44:24.027719 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.027695 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" Oct 30 23:44:24.178634 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.178602 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/84097ef4-f84f-430c-be6d-56dac7278634-tls-cert\" (UniqueName: \"kubernetes.io/secret/84097ef4-f84f-430c-be6d-56dac7278634-tls-cert\") pod \"84097ef4-f84f-430c-be6d-56dac7278634\" (UID: \"84097ef4-f84f-430c-be6d-56dac7278634\") " Oct 30 23:44:24.178758 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.178655 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/84097ef4-f84f-430c-be6d-56dac7278634-kube-api-access-9w6mp\" (UniqueName: \"kubernetes.io/projected/84097ef4-f84f-430c-be6d-56dac7278634-kube-api-access-9w6mp\") pod \"84097ef4-f84f-430c-be6d-56dac7278634\" (UID: \"84097ef4-f84f-430c-be6d-56dac7278634\") " Oct 30 23:44:24.180752 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.180722 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84097ef4-f84f-430c-be6d-56dac7278634-kube-api-access-9w6mp" pod "84097ef4-f84f-430c-be6d-56dac7278634" (UID: "84097ef4-f84f-430c-be6d-56dac7278634"). InnerVolumeSpecName "kube-api-access-9w6mp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:44:24.189375 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.189351 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84097ef4-f84f-430c-be6d-56dac7278634-tls-cert" pod "84097ef4-f84f-430c-be6d-56dac7278634" (UID: "84097ef4-f84f-430c-be6d-56dac7278634"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:44:24.279595 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.279525 5112 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84097ef4-f84f-430c-be6d-56dac7278634-tls-cert\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:44:24.279595 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.279562 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w6mp\" (UniqueName: \"kubernetes.io/projected/84097ef4-f84f-430c-be6d-56dac7278634-kube-api-access-9w6mp\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:44:24.718148 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.718031 5112 generic.go:356] "Generic (PLEG): container finished" podID="84097ef4-f84f-430c-be6d-56dac7278634" containerID="3bf796bab1ca49b119f5d3238cb2d0d3c026d77b6d60283d8357043d601c73bb" exitCode=0 Oct 30 23:44:24.718148 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.718103 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" Oct 30 23:44:24.718351 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.718140 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" event={"ID":"84097ef4-f84f-430c-be6d-56dac7278634","Type":"ContainerDied","Data":"3bf796bab1ca49b119f5d3238cb2d0d3c026d77b6d60283d8357043d601c73bb"} Oct 30 23:44:24.718351 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.718198 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68c5f4cc5-jnx4r" event={"ID":"84097ef4-f84f-430c-be6d-56dac7278634","Type":"ContainerDied","Data":"d12d9cdffe0ef03f6debc865c54fcd631e3e8bbe95ed02193429ad20c9b2232d"} Oct 30 23:44:24.718351 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.718217 5112 scope.go:122] "RemoveContainer" containerID="3bf796bab1ca49b119f5d3238cb2d0d3c026d77b6d60283d8357043d601c73bb" Oct 30 23:44:24.728970 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.728950 5112 scope.go:122] "RemoveContainer" containerID="3bf796bab1ca49b119f5d3238cb2d0d3c026d77b6d60283d8357043d601c73bb" Oct 30 23:44:24.729289 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:44:24.729265 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bf796bab1ca49b119f5d3238cb2d0d3c026d77b6d60283d8357043d601c73bb\": container with ID starting with 3bf796bab1ca49b119f5d3238cb2d0d3c026d77b6d60283d8357043d601c73bb not found: ID does not exist" containerID="3bf796bab1ca49b119f5d3238cb2d0d3c026d77b6d60283d8357043d601c73bb" Oct 30 23:44:24.729347 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.729298 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bf796bab1ca49b119f5d3238cb2d0d3c026d77b6d60283d8357043d601c73bb"} err="failed to get container status \"3bf796bab1ca49b119f5d3238cb2d0d3c026d77b6d60283d8357043d601c73bb\": rpc error: code = NotFound desc = could not find container \"3bf796bab1ca49b119f5d3238cb2d0d3c026d77b6d60283d8357043d601c73bb\": container with ID starting with 3bf796bab1ca49b119f5d3238cb2d0d3c026d77b6d60283d8357043d601c73bb not found: ID does not exist" Oct 30 23:44:24.766575 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.766548 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68c5f4cc5-jnx4r"] Oct 30 23:44:24.777620 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:24.777597 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68c5f4cc5-jnx4r"] Oct 30 23:44:25.876162 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:25.876126 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="84097ef4-f84f-430c-be6d-56dac7278634" path="/var/lib/kubelet/pods/84097ef4-f84f-430c-be6d-56dac7278634/volumes" Oct 30 23:44:52.977997 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:44:52.977913 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:44:59.280300 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.280268 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-c7987c6b6-pfcgk"] Oct 30 23:44:59.281300 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.281270 5112 cpu_manager.go:414] "containerMap: removing container" podUID="84097ef4-f84f-430c-be6d-56dac7278634" containerName="authorino" Oct 30 23:44:59.281300 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.281292 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="84097ef4-f84f-430c-be6d-56dac7278634" containerName="authorino" Oct 30 23:44:59.281495 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.281376 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="84097ef4-f84f-430c-be6d-56dac7278634" containerName="authorino" Oct 30 23:44:59.284418 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.284401 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" Oct 30 23:44:59.298429 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.298407 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Oct 30 23:44:59.298429 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.298413 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\"" Oct 30 23:44:59.311224 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.311154 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-s54bf\"" Oct 30 23:44:59.314372 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.314343 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-c7987c6b6-pfcgk"] Oct 30 23:44:59.348791 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.348765 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a851dc0-8bc8-457f-b112-e0b19af1df9c-metrics-certs\") pod \"ai-gateway-controller-c7987c6b6-pfcgk\" (UID: \"6a851dc0-8bc8-457f-b112-e0b19af1df9c\") " pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" Oct 30 23:44:59.348924 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.348902 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swxsg\" (UniqueName: \"kubernetes.io/projected/6a851dc0-8bc8-457f-b112-e0b19af1df9c-kube-api-access-swxsg\") pod \"ai-gateway-controller-c7987c6b6-pfcgk\" (UID: \"6a851dc0-8bc8-457f-b112-e0b19af1df9c\") " pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" Oct 30 23:44:59.449630 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.449605 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swxsg\" (UniqueName: \"kubernetes.io/projected/6a851dc0-8bc8-457f-b112-e0b19af1df9c-kube-api-access-swxsg\") pod \"ai-gateway-controller-c7987c6b6-pfcgk\" (UID: \"6a851dc0-8bc8-457f-b112-e0b19af1df9c\") " pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" Oct 30 23:44:59.449728 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.449642 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a851dc0-8bc8-457f-b112-e0b19af1df9c-metrics-certs\") pod \"ai-gateway-controller-c7987c6b6-pfcgk\" (UID: \"6a851dc0-8bc8-457f-b112-e0b19af1df9c\") " pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" Oct 30 23:44:59.451965 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.451940 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a851dc0-8bc8-457f-b112-e0b19af1df9c-metrics-certs\") pod \"ai-gateway-controller-c7987c6b6-pfcgk\" (UID: \"6a851dc0-8bc8-457f-b112-e0b19af1df9c\") " pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" Oct 30 23:44:59.469316 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.469295 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swxsg\" (UniqueName: \"kubernetes.io/projected/6a851dc0-8bc8-457f-b112-e0b19af1df9c-kube-api-access-swxsg\") pod \"ai-gateway-controller-c7987c6b6-pfcgk\" (UID: \"6a851dc0-8bc8-457f-b112-e0b19af1df9c\") " pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" Oct 30 23:44:59.596652 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.596582 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" Oct 30 23:44:59.891033 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.890927 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-c7987c6b6-pfcgk"] Oct 30 23:44:59.895116 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:44:59.895088 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a851dc0_8bc8_457f_b112_e0b19af1df9c.slice/crio-f3e52e667efc4af6a6112040df785db6da70ed482ba6f51db28b226c2c9a2c73 WatchSource:0}: Error finding container f3e52e667efc4af6a6112040df785db6da70ed482ba6f51db28b226c2c9a2c73: Status 404 returned error can't find the container with id f3e52e667efc4af6a6112040df785db6da70ed482ba6f51db28b226c2c9a2c73 Oct 30 23:44:59.905081 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:44:59.905030 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" event={"ID":"6a851dc0-8bc8-457f-b112-e0b19af1df9c","Type":"ContainerStarted","Data":"f3e52e667efc4af6a6112040df785db6da70ed482ba6f51db28b226c2c9a2c73"} Oct 30 23:45:00.140684 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:00.140649 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm"] Oct 30 23:45:00.145400 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:00.145349 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" Oct 30 23:45:00.159660 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:00.159640 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:45:00.159915 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:00.159868 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:45:00.160168 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:00.160098 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:45:00.161096 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:00.161072 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm"] Oct 30 23:45:00.258764 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:00.258740 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/761911c4-f1e1-47f1-a7c8-883fef176a69-maas-api-service-ca\") pod \"maas-api-key-cleanup-29890065-thsnm\" (UID: \"761911c4-f1e1-47f1-a7c8-883fef176a69\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" Oct 30 23:45:00.258856 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:00.258779 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j84bg\" (UniqueName: \"kubernetes.io/projected/761911c4-f1e1-47f1-a7c8-883fef176a69-kube-api-access-j84bg\") pod \"maas-api-key-cleanup-29890065-thsnm\" (UID: \"761911c4-f1e1-47f1-a7c8-883fef176a69\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" Oct 30 23:45:00.360005 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:00.359901 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/761911c4-f1e1-47f1-a7c8-883fef176a69-maas-api-service-ca\") pod \"maas-api-key-cleanup-29890065-thsnm\" (UID: \"761911c4-f1e1-47f1-a7c8-883fef176a69\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" Oct 30 23:45:00.360005 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:00.359960 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j84bg\" (UniqueName: \"kubernetes.io/projected/761911c4-f1e1-47f1-a7c8-883fef176a69-kube-api-access-j84bg\") pod \"maas-api-key-cleanup-29890065-thsnm\" (UID: \"761911c4-f1e1-47f1-a7c8-883fef176a69\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" Oct 30 23:45:00.360576 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:00.360553 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/761911c4-f1e1-47f1-a7c8-883fef176a69-maas-api-service-ca\") pod \"maas-api-key-cleanup-29890065-thsnm\" (UID: \"761911c4-f1e1-47f1-a7c8-883fef176a69\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" Oct 30 23:45:00.378742 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:00.378713 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j84bg\" (UniqueName: \"kubernetes.io/projected/761911c4-f1e1-47f1-a7c8-883fef176a69-kube-api-access-j84bg\") pod \"maas-api-key-cleanup-29890065-thsnm\" (UID: \"761911c4-f1e1-47f1-a7c8-883fef176a69\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" Oct 30 23:45:00.458365 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:00.458309 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" Oct 30 23:45:00.761485 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:00.761447 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm"] Oct 30 23:45:00.766077 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:45:00.766025 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761911c4_f1e1_47f1_a7c8_883fef176a69.slice/crio-b3a7fb35bcf4ee8dec178a349583094222aef1f86a40ce2b636602a0715ae882 WatchSource:0}: Error finding container b3a7fb35bcf4ee8dec178a349583094222aef1f86a40ce2b636602a0715ae882: Status 404 returned error can't find the container with id b3a7fb35bcf4ee8dec178a349583094222aef1f86a40ce2b636602a0715ae882 Oct 30 23:45:00.912141 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:00.912106 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" event={"ID":"761911c4-f1e1-47f1-a7c8-883fef176a69","Type":"ContainerStarted","Data":"b3a7fb35bcf4ee8dec178a349583094222aef1f86a40ce2b636602a0715ae882"} Oct 30 23:45:01.919761 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:01.919724 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" event={"ID":"6a851dc0-8bc8-457f-b112-e0b19af1df9c","Type":"ContainerStarted","Data":"2fc14cf8b1fff25db270fe21828c933eb5fd98f0e909bf4fedbea8d9b058bae5"} Oct 30 23:45:01.920176 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:01.919857 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" Oct 30 23:45:01.958636 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:01.958567 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" podStartSLOduration=1.598258068 podStartE2EDuration="2.958553984s" totalImagesPullingTime="1.360295916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:01.957232701 +0000 UTC m=+590.221138273" watchObservedRunningTime="2026-10-30 23:45:01.958553984 +0000 UTC m=+590.222459556" Oct 30 23:45:02.607413 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:02.607374 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft"] Oct 30 23:45:02.614674 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:02.614648 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft" Oct 30 23:45:02.627582 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:02.627548 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft"] Oct 30 23:45:02.660743 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:02.660692 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Oct 30 23:45:02.665730 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:02.665706 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xp5g5\"" Oct 30 23:45:02.680819 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:02.680793 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5m8m\" (UniqueName: \"kubernetes.io/projected/3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868-kube-api-access-b5m8m\") pod \"payload-pre-processing-7b98bb678c-vc4ft\" (UID: \"3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft" Oct 30 23:45:02.680918 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:02.680840 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-vc4ft\" (UID: \"3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft" Oct 30 23:45:02.781781 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:02.781754 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-vc4ft\" (UID: \"3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft" Oct 30 23:45:02.781940 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:02.781897 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5m8m\" (UniqueName: \"kubernetes.io/projected/3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868-kube-api-access-b5m8m\") pod \"payload-pre-processing-7b98bb678c-vc4ft\" (UID: \"3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft" Oct 30 23:45:02.782648 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:02.782622 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-vc4ft\" (UID: \"3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft" Oct 30 23:45:02.800458 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:02.800436 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5m8m\" (UniqueName: \"kubernetes.io/projected/3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868-kube-api-access-b5m8m\") pod \"payload-pre-processing-7b98bb678c-vc4ft\" (UID: \"3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft" Oct 30 23:45:02.932973 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:02.932901 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft" Oct 30 23:45:03.236470 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:03.236446 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft"] Oct 30 23:45:03.240791 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:45:03.240766 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa7d2a7_0c91_4dfc_83cb_e3fa96fc3868.slice/crio-e8d7236921cb6df18ae70a11a7fb091ddb9a92f297ac631acba931601252890f WatchSource:0}: Error finding container e8d7236921cb6df18ae70a11a7fb091ddb9a92f297ac631acba931601252890f: Status 404 returned error can't find the container with id e8d7236921cb6df18ae70a11a7fb091ddb9a92f297ac631acba931601252890f Oct 30 23:45:03.933088 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:03.933029 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" event={"ID":"761911c4-f1e1-47f1-a7c8-883fef176a69","Type":"ContainerStarted","Data":"4a49485d0f97bcd9a69e3e75851729776409f638bb4b181ffdf01f0d0e57c662"} Oct 30 23:45:03.934636 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:03.934607 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft" event={"ID":"3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868","Type":"ContainerStarted","Data":"e8d7236921cb6df18ae70a11a7fb091ddb9a92f297ac631acba931601252890f"} Oct 30 23:45:03.976071 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:03.973932 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" podStartSLOduration=1.520742157 podStartE2EDuration="3.973913598s" totalImagesPullingTime="2.453171441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:03.971357265 +0000 UTC m=+592.235262838" watchObservedRunningTime="2026-10-30 23:45:03.973913598 +0000 UTC m=+592.237819174" Oct 30 23:45:04.941499 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:04.941466 5112 generic.go:356] "Generic (PLEG): container finished" podID="761911c4-f1e1-47f1-a7c8-883fef176a69" containerID="4a49485d0f97bcd9a69e3e75851729776409f638bb4b181ffdf01f0d0e57c662" exitCode=60 Oct 30 23:45:04.941971 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:04.941533 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" event={"ID":"761911c4-f1e1-47f1-a7c8-883fef176a69","Type":"ContainerDied","Data":"4a49485d0f97bcd9a69e3e75851729776409f638bb4b181ffdf01f0d0e57c662"} Oct 30 23:45:04.941971 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:04.941753 5112 scope.go:122] "RemoveContainer" containerID="4a49485d0f97bcd9a69e3e75851729776409f638bb4b181ffdf01f0d0e57c662" Oct 30 23:45:05.948584 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:05.948516 5112 generic.go:356] "Generic (PLEG): container finished" podID="761911c4-f1e1-47f1-a7c8-883fef176a69" containerID="fa0bb14240c3a3d1b9df6da4eaf8084feeba7413901d679786c6f5b19ca30461" exitCode=60 Oct 30 23:45:05.948584 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:05.948562 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" event={"ID":"761911c4-f1e1-47f1-a7c8-883fef176a69","Type":"ContainerDied","Data":"fa0bb14240c3a3d1b9df6da4eaf8084feeba7413901d679786c6f5b19ca30461"} Oct 30 23:45:05.948994 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:05.948629 5112 scope.go:122] "RemoveContainer" containerID="4a49485d0f97bcd9a69e3e75851729776409f638bb4b181ffdf01f0d0e57c662" Oct 30 23:45:05.948994 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:05.948821 5112 scope.go:122] "RemoveContainer" containerID="fa0bb14240c3a3d1b9df6da4eaf8084feeba7413901d679786c6f5b19ca30461" Oct 30 23:45:05.949123 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:45:05.949036 5112 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29890065-thsnm_odh-ai-gateway-infra(761911c4-f1e1-47f1-a7c8-883fef176a69)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" podUID="761911c4-f1e1-47f1-a7c8-883fef176a69" Oct 30 23:45:05.950412 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:05.950392 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft" event={"ID":"3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868","Type":"ContainerStarted","Data":"a13a60a20269ac4db3adcaf4db8808ea58ba4c9b4d4384dcde78af11ba314446"} Oct 30 23:45:05.950493 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:05.950444 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft" Oct 30 23:45:06.025905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:06.025848 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft" podStartSLOduration=2.094277792 podStartE2EDuration="4.025834211s" totalImagesPullingTime="1.931556419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:06.023532856 +0000 UTC m=+594.287438429" watchObservedRunningTime="2026-10-30 23:45:06.025834211 +0000 UTC m=+594.289739777" Oct 30 23:45:06.958180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:06.958139 5112 scope.go:122] "RemoveContainer" containerID="fa0bb14240c3a3d1b9df6da4eaf8084feeba7413901d679786c6f5b19ca30461" Oct 30 23:45:06.958647 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:45:06.958363 5112 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29890065-thsnm_odh-ai-gateway-infra(761911c4-f1e1-47f1-a7c8-883fef176a69)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" podUID="761911c4-f1e1-47f1-a7c8-883fef176a69" Oct 30 23:45:11.947998 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:11.947973 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/2.log" Oct 30 23:45:11.948431 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:11.948413 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/2.log" Oct 30 23:45:12.928940 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:12.928913 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" Oct 30 23:45:14.473102 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:14.473072 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-portal-stand-in-588fd98845-cjpx4"] Oct 30 23:45:14.478151 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:14.478126 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-portal-stand-in-588fd98845-cjpx4" Oct 30 23:45:14.491562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:14.491533 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-portal-stand-in-588fd98845-cjpx4"] Oct 30 23:45:14.492019 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:14.491998 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mfmqp\"" Oct 30 23:45:14.579606 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:14.579570 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kzw8\" (UniqueName: \"kubernetes.io/projected/1d68c068-813f-470a-a96c-82af39d64394-kube-api-access-9kzw8\") pod \"maas-portal-stand-in-588fd98845-cjpx4\" (UID: \"1d68c068-813f-470a-a96c-82af39d64394\") " pod="opendatahub/maas-portal-stand-in-588fd98845-cjpx4" Oct 30 23:45:14.681088 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:14.681031 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kzw8\" (UniqueName: \"kubernetes.io/projected/1d68c068-813f-470a-a96c-82af39d64394-kube-api-access-9kzw8\") pod \"maas-portal-stand-in-588fd98845-cjpx4\" (UID: \"1d68c068-813f-470a-a96c-82af39d64394\") " pod="opendatahub/maas-portal-stand-in-588fd98845-cjpx4" Oct 30 23:45:14.699797 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:14.699770 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kzw8\" (UniqueName: \"kubernetes.io/projected/1d68c068-813f-470a-a96c-82af39d64394-kube-api-access-9kzw8\") pod \"maas-portal-stand-in-588fd98845-cjpx4\" (UID: \"1d68c068-813f-470a-a96c-82af39d64394\") " pod="opendatahub/maas-portal-stand-in-588fd98845-cjpx4" Oct 30 23:45:14.791439 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:14.791415 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-portal-stand-in-588fd98845-cjpx4" Oct 30 23:45:15.087371 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:15.087258 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-portal-stand-in-588fd98845-cjpx4"] Oct 30 23:45:15.092156 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:45:15.092130 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d68c068_813f_470a_a96c_82af39d64394.slice/crio-17251f4596a2b2f1d3e403bcbde46f68e709f5dc670bf8c2cb171414482777bf WatchSource:0}: Error finding container 17251f4596a2b2f1d3e403bcbde46f68e709f5dc670bf8c2cb171414482777bf: Status 404 returned error can't find the container with id 17251f4596a2b2f1d3e403bcbde46f68e709f5dc670bf8c2cb171414482777bf Oct 30 23:45:16.004089 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:16.004031 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-portal-stand-in-588fd98845-cjpx4" event={"ID":"1d68c068-813f-470a-a96c-82af39d64394","Type":"ContainerStarted","Data":"ff7ed3353bb7dc7d7829d4b50eed18295042b6fcb321a005fe5750b322306056"} Oct 30 23:45:16.004600 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:16.004577 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-portal-stand-in-588fd98845-cjpx4" event={"ID":"1d68c068-813f-470a-a96c-82af39d64394","Type":"ContainerStarted","Data":"17251f4596a2b2f1d3e403bcbde46f68e709f5dc670bf8c2cb171414482777bf"} Oct 30 23:45:16.043544 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:16.043501 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-portal-stand-in-588fd98845-cjpx4" podStartSLOduration=1.5701617570000002 podStartE2EDuration="2.043489509s" totalImagesPullingTime="473.327752ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:16.041244932 +0000 UTC m=+604.305150504" watchObservedRunningTime="2026-10-30 23:45:16.043489509 +0000 UTC m=+604.307395080" Oct 30 23:45:16.960842 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:16.960812 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-vc4ft" Oct 30 23:45:17.869591 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:17.869559 5112 scope.go:122] "RemoveContainer" containerID="fa0bb14240c3a3d1b9df6da4eaf8084feeba7413901d679786c6f5b19ca30461" Oct 30 23:45:19.022248 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:19.022220 5112 generic.go:356] "Generic (PLEG): container finished" podID="761911c4-f1e1-47f1-a7c8-883fef176a69" containerID="71982f5cfb2a62ee693932f8edf115291f80380af17c057423c667dec4e01b9b" exitCode=60 Oct 30 23:45:19.022609 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:19.022289 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" event={"ID":"761911c4-f1e1-47f1-a7c8-883fef176a69","Type":"ContainerDied","Data":"71982f5cfb2a62ee693932f8edf115291f80380af17c057423c667dec4e01b9b"} Oct 30 23:45:19.022609 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:19.022346 5112 scope.go:122] "RemoveContainer" containerID="fa0bb14240c3a3d1b9df6da4eaf8084feeba7413901d679786c6f5b19ca30461" Oct 30 23:45:19.022609 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:19.022605 5112 scope.go:122] "RemoveContainer" containerID="71982f5cfb2a62ee693932f8edf115291f80380af17c057423c667dec4e01b9b" Oct 30 23:45:19.022793 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:45:19.022773 5112 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29890065-thsnm_odh-ai-gateway-infra(761911c4-f1e1-47f1-a7c8-883fef176a69)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" podUID="761911c4-f1e1-47f1-a7c8-883fef176a69" Oct 30 23:45:20.071774 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:20.071739 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm"] Oct 30 23:45:20.207913 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:20.207888 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" Oct 30 23:45:20.327285 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:20.327224 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/761911c4-f1e1-47f1-a7c8-883fef176a69-kube-api-access-j84bg\" (UniqueName: \"kubernetes.io/projected/761911c4-f1e1-47f1-a7c8-883fef176a69-kube-api-access-j84bg\") pod \"761911c4-f1e1-47f1-a7c8-883fef176a69\" (UID: \"761911c4-f1e1-47f1-a7c8-883fef176a69\") " Oct 30 23:45:20.327285 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:20.327282 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/761911c4-f1e1-47f1-a7c8-883fef176a69-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/761911c4-f1e1-47f1-a7c8-883fef176a69-maas-api-service-ca\") pod \"761911c4-f1e1-47f1-a7c8-883fef176a69\" (UID: \"761911c4-f1e1-47f1-a7c8-883fef176a69\") " Oct 30 23:45:20.327627 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:20.327598 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/761911c4-f1e1-47f1-a7c8-883fef176a69-maas-api-service-ca" pod "761911c4-f1e1-47f1-a7c8-883fef176a69" (UID: "761911c4-f1e1-47f1-a7c8-883fef176a69"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:45:20.329246 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:20.329225 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/761911c4-f1e1-47f1-a7c8-883fef176a69-kube-api-access-j84bg" pod "761911c4-f1e1-47f1-a7c8-883fef176a69" (UID: "761911c4-f1e1-47f1-a7c8-883fef176a69"). InnerVolumeSpecName "kube-api-access-j84bg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:45:20.428834 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:20.428811 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j84bg\" (UniqueName: \"kubernetes.io/projected/761911c4-f1e1-47f1-a7c8-883fef176a69-kube-api-access-j84bg\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:45:20.428834 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:20.428832 5112 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/761911c4-f1e1-47f1-a7c8-883fef176a69-maas-api-service-ca\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:45:21.035800 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:21.035763 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" event={"ID":"761911c4-f1e1-47f1-a7c8-883fef176a69","Type":"ContainerDied","Data":"b3a7fb35bcf4ee8dec178a349583094222aef1f86a40ce2b636602a0715ae882"} Oct 30 23:45:21.035800 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:21.035782 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm" Oct 30 23:45:21.036003 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:21.035849 5112 scope.go:122] "RemoveContainer" containerID="71982f5cfb2a62ee693932f8edf115291f80380af17c057423c667dec4e01b9b" Oct 30 23:45:21.083594 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:21.083567 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm"] Oct 30 23:45:21.088832 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:21.088805 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890065-thsnm"] Oct 30 23:45:21.876260 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:21.876229 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="761911c4-f1e1-47f1-a7c8-883fef176a69" path="/var/lib/kubelet/pods/761911c4-f1e1-47f1-a7c8-883fef176a69/volumes" Oct 30 23:45:22.976291 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:45:22.976256 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:45:27.504089 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.504051 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-6f56955584-s8vq9"] Oct 30 23:45:27.504499 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.504485 5112 cpu_manager.go:414] "containerMap: removing container" podUID="761911c4-f1e1-47f1-a7c8-883fef176a69" containerName="cleanup" Oct 30 23:45:27.504548 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.504500 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="761911c4-f1e1-47f1-a7c8-883fef176a69" containerName="cleanup" Oct 30 23:45:27.504548 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.504519 5112 cpu_manager.go:414] "containerMap: removing container" podUID="761911c4-f1e1-47f1-a7c8-883fef176a69" containerName="cleanup" Oct 30 23:45:27.504548 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.504525 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="761911c4-f1e1-47f1-a7c8-883fef176a69" containerName="cleanup" Oct 30 23:45:27.504638 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.504607 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="761911c4-f1e1-47f1-a7c8-883fef176a69" containerName="cleanup" Oct 30 23:45:27.504638 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.504616 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="761911c4-f1e1-47f1-a7c8-883fef176a69" containerName="cleanup" Oct 30 23:45:27.511384 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.511361 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6f56955584-s8vq9" Oct 30 23:45:27.524680 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.524659 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6f56955584-s8vq9"] Oct 30 23:45:27.584060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.584019 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06bd7b3-e785-4d8c-bb65-c56c89b32dd4-metrics-certs\") pod \"ai-gateway-controller-6f56955584-s8vq9\" (UID: \"d06bd7b3-e785-4d8c-bb65-c56c89b32dd4\") " pod="opendatahub/ai-gateway-controller-6f56955584-s8vq9" Oct 30 23:45:27.584165 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.584145 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgdjw\" (UniqueName: \"kubernetes.io/projected/d06bd7b3-e785-4d8c-bb65-c56c89b32dd4-kube-api-access-zgdjw\") pod \"ai-gateway-controller-6f56955584-s8vq9\" (UID: \"d06bd7b3-e785-4d8c-bb65-c56c89b32dd4\") " pod="opendatahub/ai-gateway-controller-6f56955584-s8vq9" Oct 30 23:45:27.685300 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.685276 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06bd7b3-e785-4d8c-bb65-c56c89b32dd4-metrics-certs\") pod \"ai-gateway-controller-6f56955584-s8vq9\" (UID: \"d06bd7b3-e785-4d8c-bb65-c56c89b32dd4\") " pod="opendatahub/ai-gateway-controller-6f56955584-s8vq9" Oct 30 23:45:27.685409 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.685345 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgdjw\" (UniqueName: \"kubernetes.io/projected/d06bd7b3-e785-4d8c-bb65-c56c89b32dd4-kube-api-access-zgdjw\") pod \"ai-gateway-controller-6f56955584-s8vq9\" (UID: \"d06bd7b3-e785-4d8c-bb65-c56c89b32dd4\") " pod="opendatahub/ai-gateway-controller-6f56955584-s8vq9" Oct 30 23:45:27.687648 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.687627 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06bd7b3-e785-4d8c-bb65-c56c89b32dd4-metrics-certs\") pod \"ai-gateway-controller-6f56955584-s8vq9\" (UID: \"d06bd7b3-e785-4d8c-bb65-c56c89b32dd4\") " pod="opendatahub/ai-gateway-controller-6f56955584-s8vq9" Oct 30 23:45:27.704243 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.704218 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgdjw\" (UniqueName: \"kubernetes.io/projected/d06bd7b3-e785-4d8c-bb65-c56c89b32dd4-kube-api-access-zgdjw\") pod \"ai-gateway-controller-6f56955584-s8vq9\" (UID: \"d06bd7b3-e785-4d8c-bb65-c56c89b32dd4\") " pod="opendatahub/ai-gateway-controller-6f56955584-s8vq9" Oct 30 23:45:27.824586 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:27.824531 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6f56955584-s8vq9" Oct 30 23:45:28.122236 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:28.122163 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6f56955584-s8vq9"] Oct 30 23:45:28.126068 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:45:28.126025 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06bd7b3_e785_4d8c_bb65_c56c89b32dd4.slice/crio-c550f16555aaa56849c6ecc2349172d1c52cdcfe00283c1ec9baf42466d9c4ac WatchSource:0}: Error finding container c550f16555aaa56849c6ecc2349172d1c52cdcfe00283c1ec9baf42466d9c4ac: Status 404 returned error can't find the container with id c550f16555aaa56849c6ecc2349172d1c52cdcfe00283c1ec9baf42466d9c4ac Oct 30 23:45:29.078711 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:29.078679 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6f56955584-s8vq9" event={"ID":"d06bd7b3-e785-4d8c-bb65-c56c89b32dd4","Type":"ContainerStarted","Data":"6375b1129328251244bab3116dba9b362713726f223801b7bdd8622e8edb362e"} Oct 30 23:45:29.079123 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:29.078728 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6f56955584-s8vq9" event={"ID":"d06bd7b3-e785-4d8c-bb65-c56c89b32dd4","Type":"ContainerStarted","Data":"c550f16555aaa56849c6ecc2349172d1c52cdcfe00283c1ec9baf42466d9c4ac"} Oct 30 23:45:29.079123 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:29.078776 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-6f56955584-s8vq9" Oct 30 23:45:29.115890 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:29.115847 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-6f56955584-s8vq9" podStartSLOduration=1.7421473 podStartE2EDuration="2.11583342s" totalImagesPullingTime="373.68612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:29.115100266 +0000 UTC m=+617.379005838" watchObservedRunningTime="2026-10-30 23:45:29.11583342 +0000 UTC m=+617.379738989" Oct 30 23:45:40.086109 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:40.086071 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-6f56955584-s8vq9" Oct 30 23:45:40.191905 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:40.191873 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-c7987c6b6-pfcgk"] Oct 30 23:45:40.192153 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:40.192104 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" podUID="6a851dc0-8bc8-457f-b112-e0b19af1df9c" containerName="manager" containerID="cri-o://2fc14cf8b1fff25db270fe21828c933eb5fd98f0e909bf4fedbea8d9b058bae5" gracePeriod=30 Oct 30 23:45:40.439634 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:40.439612 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" Oct 30 23:45:40.494481 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:40.494453 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a851dc0-8bc8-457f-b112-e0b19af1df9c-kube-api-access-swxsg\" (UniqueName: \"kubernetes.io/projected/6a851dc0-8bc8-457f-b112-e0b19af1df9c-kube-api-access-swxsg\") pod \"6a851dc0-8bc8-457f-b112-e0b19af1df9c\" (UID: \"6a851dc0-8bc8-457f-b112-e0b19af1df9c\") " Oct 30 23:45:40.494619 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:40.494574 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6a851dc0-8bc8-457f-b112-e0b19af1df9c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a851dc0-8bc8-457f-b112-e0b19af1df9c-metrics-certs\") pod \"6a851dc0-8bc8-457f-b112-e0b19af1df9c\" (UID: \"6a851dc0-8bc8-457f-b112-e0b19af1df9c\") " Oct 30 23:45:40.496516 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:40.496491 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a851dc0-8bc8-457f-b112-e0b19af1df9c-metrics-certs" pod "6a851dc0-8bc8-457f-b112-e0b19af1df9c" (UID: "6a851dc0-8bc8-457f-b112-e0b19af1df9c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:45:40.496667 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:40.496641 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a851dc0-8bc8-457f-b112-e0b19af1df9c-kube-api-access-swxsg" pod "6a851dc0-8bc8-457f-b112-e0b19af1df9c" (UID: "6a851dc0-8bc8-457f-b112-e0b19af1df9c"). InnerVolumeSpecName "kube-api-access-swxsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:45:40.595317 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:40.595296 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swxsg\" (UniqueName: \"kubernetes.io/projected/6a851dc0-8bc8-457f-b112-e0b19af1df9c-kube-api-access-swxsg\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:45:40.595317 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:40.595317 5112 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a851dc0-8bc8-457f-b112-e0b19af1df9c-metrics-certs\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:45:41.142663 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:41.142627 5112 generic.go:356] "Generic (PLEG): container finished" podID="6a851dc0-8bc8-457f-b112-e0b19af1df9c" containerID="2fc14cf8b1fff25db270fe21828c933eb5fd98f0e909bf4fedbea8d9b058bae5" exitCode=0 Oct 30 23:45:41.143078 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:41.142687 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" Oct 30 23:45:41.143078 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:41.142704 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" event={"ID":"6a851dc0-8bc8-457f-b112-e0b19af1df9c","Type":"ContainerDied","Data":"2fc14cf8b1fff25db270fe21828c933eb5fd98f0e909bf4fedbea8d9b058bae5"} Oct 30 23:45:41.143078 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:41.142771 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-c7987c6b6-pfcgk" event={"ID":"6a851dc0-8bc8-457f-b112-e0b19af1df9c","Type":"ContainerDied","Data":"f3e52e667efc4af6a6112040df785db6da70ed482ba6f51db28b226c2c9a2c73"} Oct 30 23:45:41.143078 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:41.142807 5112 scope.go:122] "RemoveContainer" containerID="2fc14cf8b1fff25db270fe21828c933eb5fd98f0e909bf4fedbea8d9b058bae5" Oct 30 23:45:41.153333 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:41.153310 5112 scope.go:122] "RemoveContainer" containerID="2fc14cf8b1fff25db270fe21828c933eb5fd98f0e909bf4fedbea8d9b058bae5" Oct 30 23:45:41.153668 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:45:41.153644 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fc14cf8b1fff25db270fe21828c933eb5fd98f0e909bf4fedbea8d9b058bae5\": container with ID starting with 2fc14cf8b1fff25db270fe21828c933eb5fd98f0e909bf4fedbea8d9b058bae5 not found: ID does not exist" containerID="2fc14cf8b1fff25db270fe21828c933eb5fd98f0e909bf4fedbea8d9b058bae5" Oct 30 23:45:41.153718 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:41.153678 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc14cf8b1fff25db270fe21828c933eb5fd98f0e909bf4fedbea8d9b058bae5"} err="failed to get container status \"2fc14cf8b1fff25db270fe21828c933eb5fd98f0e909bf4fedbea8d9b058bae5\": rpc error: code = NotFound desc = could not find container \"2fc14cf8b1fff25db270fe21828c933eb5fd98f0e909bf4fedbea8d9b058bae5\": container with ID starting with 2fc14cf8b1fff25db270fe21828c933eb5fd98f0e909bf4fedbea8d9b058bae5 not found: ID does not exist" Oct 30 23:45:41.182510 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:45:41.182483 5112 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a851dc0_8bc8_457f_b112_e0b19af1df9c.slice\": RecentStats: unable to find data in memory cache]" Oct 30 23:45:41.191826 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:41.191801 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-c7987c6b6-pfcgk"] Oct 30 23:45:41.194896 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:41.194875 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-c7987c6b6-pfcgk"] Oct 30 23:45:41.883886 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:41.883820 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6a851dc0-8bc8-457f-b112-e0b19af1df9c" path="/var/lib/kubelet/pods/6a851dc0-8bc8-457f-b112-e0b19af1df9c/volumes" Oct 30 23:45:47.353274 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.353242 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj"] Oct 30 23:45:47.353862 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.353834 5112 cpu_manager.go:414] "containerMap: removing container" podUID="761911c4-f1e1-47f1-a7c8-883fef176a69" containerName="cleanup" Oct 30 23:45:47.353862 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.353860 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="761911c4-f1e1-47f1-a7c8-883fef176a69" containerName="cleanup" Oct 30 23:45:47.354020 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.353879 5112 cpu_manager.go:414] "containerMap: removing container" podUID="6a851dc0-8bc8-457f-b112-e0b19af1df9c" containerName="manager" Oct 30 23:45:47.354020 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.353888 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6a851dc0-8bc8-457f-b112-e0b19af1df9c" containerName="manager" Oct 30 23:45:47.354020 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.353996 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="761911c4-f1e1-47f1-a7c8-883fef176a69" containerName="cleanup" Oct 30 23:45:47.354020 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.354005 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="6a851dc0-8bc8-457f-b112-e0b19af1df9c" containerName="manager" Oct 30 23:45:47.358560 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.358539 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.377890 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.377865 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj"] Oct 30 23:45:47.378175 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.378158 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Oct 30 23:45:47.385988 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.385967 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nhgkf\"" Oct 30 23:45:47.386123 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.386028 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Oct 30 23:45:47.386123 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.386100 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Oct 30 23:45:47.456199 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.456155 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.456377 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.456199 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.456377 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.456288 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.456377 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.456344 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.457269 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.456550 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.457269 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.456605 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89xgn\" (UniqueName: \"kubernetes.io/projected/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-kube-api-access-89xgn\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.557968 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.557943 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.558098 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.557973 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.558098 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.557992 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.558098 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.558024 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.558098 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.558090 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.558283 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.558120 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89xgn\" (UniqueName: \"kubernetes.io/projected/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-kube-api-access-89xgn\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.558426 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.558402 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.558491 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.558466 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.558574 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.558552 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.560222 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.560201 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.560538 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.560523 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.575765 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.575747 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89xgn\" (UniqueName: \"kubernetes.io/projected/81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd-kube-api-access-89xgn\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj\" (UID: \"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.671608 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.671539 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:47.967352 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.967285 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj"] Oct 30 23:45:47.971927 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:45:47.971897 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a7205c_6c4b_4635_9f6f_dc7a3bd55bdd.slice/crio-9872384bf0939d57ba79c74c9cbfbbc6dfef1cdef0cfa123edbb795b9108e1f5 WatchSource:0}: Error finding container 9872384bf0939d57ba79c74c9cbfbbc6dfef1cdef0cfa123edbb795b9108e1f5: Status 404 returned error can't find the container with id 9872384bf0939d57ba79c74c9cbfbbc6dfef1cdef0cfa123edbb795b9108e1f5 Oct 30 23:45:47.973219 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:47.973200 5112 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 23:45:48.180022 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:48.179995 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" event={"ID":"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd","Type":"ContainerStarted","Data":"9872384bf0939d57ba79c74c9cbfbbc6dfef1cdef0cfa123edbb795b9108e1f5"} Oct 30 23:45:50.199180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:50.199146 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" event={"ID":"81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd","Type":"ContainerStarted","Data":"009f18da5097b23ce3652a99ad1b3126d0aa3d91b6b62f7ed9c625d7b685ceab"} Oct 30 23:45:50.240276 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:50.240225 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" podStartSLOduration=1.9531868989999999 podStartE2EDuration="3.240212039s" totalImagesPullingTime="1.28702514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:50.238942448 +0000 UTC m=+638.502848022" watchObservedRunningTime="2026-10-30 23:45:50.240212039 +0000 UTC m=+638.504117611" Oct 30 23:45:50.672657 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:50.672629 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:52.974440 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:45:52.974407 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:45:55.006074 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.006021 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb"] Oct 30 23:45:55.009914 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.009891 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.037221 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.037196 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Oct 30 23:45:55.039271 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.039248 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb"] Oct 30 23:45:55.136467 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.136441 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/050a281e-181c-4ef5-b388-c0714ce5a772-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.136581 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.136488 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/050a281e-181c-4ef5-b388-c0714ce5a772-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.136581 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.136568 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lcwb\" (UniqueName: \"kubernetes.io/projected/050a281e-181c-4ef5-b388-c0714ce5a772-kube-api-access-5lcwb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.136657 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.136629 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/050a281e-181c-4ef5-b388-c0714ce5a772-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.136657 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.136646 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/050a281e-181c-4ef5-b388-c0714ce5a772-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.136750 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.136731 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/050a281e-181c-4ef5-b388-c0714ce5a772-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.237822 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.237791 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/050a281e-181c-4ef5-b388-c0714ce5a772-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.237822 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.237823 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/050a281e-181c-4ef5-b388-c0714ce5a772-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.238009 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.237855 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/050a281e-181c-4ef5-b388-c0714ce5a772-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.238009 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.237894 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/050a281e-181c-4ef5-b388-c0714ce5a772-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.238009 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.237956 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/050a281e-181c-4ef5-b388-c0714ce5a772-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.238009 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.238004 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lcwb\" (UniqueName: \"kubernetes.io/projected/050a281e-181c-4ef5-b388-c0714ce5a772-kube-api-access-5lcwb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.238289 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.238263 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/050a281e-181c-4ef5-b388-c0714ce5a772-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.238458 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.238305 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/050a281e-181c-4ef5-b388-c0714ce5a772-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.238458 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.238396 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/050a281e-181c-4ef5-b388-c0714ce5a772-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.240207 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.240185 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/050a281e-181c-4ef5-b388-c0714ce5a772-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.240457 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.240441 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/050a281e-181c-4ef5-b388-c0714ce5a772-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.256447 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.256397 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lcwb\" (UniqueName: \"kubernetes.io/projected/050a281e-181c-4ef5-b388-c0714ce5a772-kube-api-access-5lcwb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb\" (UID: \"050a281e-181c-4ef5-b388-c0714ce5a772\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.323322 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.323298 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:55.618035 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:55.617958 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb"] Oct 30 23:45:55.622098 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:45:55.622067 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050a281e_181c_4ef5_b388_c0714ce5a772.slice/crio-427f3e57606be57d0f834d9a9b29b11838c6357e60d340d2838cff5f66aeb0e4 WatchSource:0}: Error finding container 427f3e57606be57d0f834d9a9b29b11838c6357e60d340d2838cff5f66aeb0e4: Status 404 returned error can't find the container with id 427f3e57606be57d0f834d9a9b29b11838c6357e60d340d2838cff5f66aeb0e4 Oct 30 23:45:56.230956 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:56.230921 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" event={"ID":"050a281e-181c-4ef5-b388-c0714ce5a772","Type":"ContainerStarted","Data":"59266bac1eb49ad3794d124daa4ea584c3ca5d29374dbb421ebb6e4497d62fc2"} Oct 30 23:45:56.231403 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:56.230977 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" event={"ID":"050a281e-181c-4ef5-b388-c0714ce5a772","Type":"ContainerStarted","Data":"427f3e57606be57d0f834d9a9b29b11838c6357e60d340d2838cff5f66aeb0e4"} Oct 30 23:45:56.271093 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:56.271027 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" podStartSLOduration=2.103305331 podStartE2EDuration="2.271011948s" totalImagesPullingTime="167.706617ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:56.268783033 +0000 UTC m=+644.532688607" watchObservedRunningTime="2026-10-30 23:45:56.271011948 +0000 UTC m=+644.534917520" Oct 30 23:45:56.323508 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:56.323484 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:45:56.913160 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:56.913127 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-vjgt7"] Oct 30 23:45:56.917824 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:56.917784 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:56.941175 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:56.941148 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-vjgt7"] Oct 30 23:45:56.949664 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:56.949644 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\"" Oct 30 23:45:57.051923 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.051889 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0453a7e7-cd4b-4def-9685-b6f36b235a1d-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.052135 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.051931 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0453a7e7-cd4b-4def-9685-b6f36b235a1d-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.052207 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.052141 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0453a7e7-cd4b-4def-9685-b6f36b235a1d-home\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.052251 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.052208 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0453a7e7-cd4b-4def-9685-b6f36b235a1d-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.052251 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.052234 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0453a7e7-cd4b-4def-9685-b6f36b235a1d-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.052317 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.052281 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pjms\" (UniqueName: \"kubernetes.io/projected/0453a7e7-cd4b-4def-9685-b6f36b235a1d-kube-api-access-9pjms\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.153432 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.153389 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0453a7e7-cd4b-4def-9685-b6f36b235a1d-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.153623 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.153444 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0453a7e7-cd4b-4def-9685-b6f36b235a1d-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.153623 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.153519 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0453a7e7-cd4b-4def-9685-b6f36b235a1d-home\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.153623 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.153547 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0453a7e7-cd4b-4def-9685-b6f36b235a1d-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.153623 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.153571 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0453a7e7-cd4b-4def-9685-b6f36b235a1d-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.153623 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.153621 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pjms\" (UniqueName: \"kubernetes.io/projected/0453a7e7-cd4b-4def-9685-b6f36b235a1d-kube-api-access-9pjms\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.154190 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.153901 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0453a7e7-cd4b-4def-9685-b6f36b235a1d-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.154190 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.153935 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0453a7e7-cd4b-4def-9685-b6f36b235a1d-home\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.154190 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.154149 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0453a7e7-cd4b-4def-9685-b6f36b235a1d-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.155929 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.155906 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0453a7e7-cd4b-4def-9685-b6f36b235a1d-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.156417 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.156395 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0453a7e7-cd4b-4def-9685-b6f36b235a1d-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.176709 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.176627 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pjms\" (UniqueName: \"kubernetes.io/projected/0453a7e7-cd4b-4def-9685-b6f36b235a1d-kube-api-access-9pjms\") pod \"echo-simulator-kserve-64b6f8f96c-vjgt7\" (UID: \"0453a7e7-cd4b-4def-9685-b6f36b235a1d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.233668 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.233626 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:45:57.534274 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.534240 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-vjgt7"] Oct 30 23:45:57.539571 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:45:57.539536 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0453a7e7_cd4b_4def_9685_b6f36b235a1d.slice/crio-1773aed17255f3b8aa8e0dbd0e2ef2cf35809199dc0be92a60087054de13afdf WatchSource:0}: Error finding container 1773aed17255f3b8aa8e0dbd0e2ef2cf35809199dc0be92a60087054de13afdf: Status 404 returned error can't find the container with id 1773aed17255f3b8aa8e0dbd0e2ef2cf35809199dc0be92a60087054de13afdf Oct 30 23:45:57.672514 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.672486 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:57.690303 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:57.690276 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:58.244190 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:58.244158 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" event={"ID":"0453a7e7-cd4b-4def-9685-b6f36b235a1d","Type":"ContainerStarted","Data":"1773aed17255f3b8aa8e0dbd0e2ef2cf35809199dc0be92a60087054de13afdf"} Oct 30 23:45:58.258276 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:58.258251 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj" Oct 30 23:45:59.250799 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:59.250765 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" event={"ID":"0453a7e7-cd4b-4def-9685-b6f36b235a1d","Type":"ContainerStarted","Data":"7554728e906b2f89094d1fb4aa0509e8ad38408901c176d2332ee2d0423adcda"} Oct 30 23:45:59.288534 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:59.288491 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" podStartSLOduration=1.7127003969999999 podStartE2EDuration="3.288477541s" totalImagesPullingTime="1.575777144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:59.287595912 +0000 UTC m=+647.551501483" watchObservedRunningTime="2026-10-30 23:45:59.288477541 +0000 UTC m=+647.552383112" Oct 30 23:45:59.868348 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:59.868319 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j"] Oct 30 23:45:59.872177 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:59.872148 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:45:59.897566 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:59.897541 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Oct 30 23:45:59.900016 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:59.899996 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j"] Oct 30 23:45:59.987032 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:59.986994 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da8ed147-5cc6-47c4-81d9-e4911e3d247f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:45:59.987166 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:59.987036 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vdcv\" (UniqueName: \"kubernetes.io/projected/da8ed147-5cc6-47c4-81d9-e4911e3d247f-kube-api-access-9vdcv\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:45:59.987166 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:59.987135 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da8ed147-5cc6-47c4-81d9-e4911e3d247f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:45:59.987296 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:59.987182 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8ed147-5cc6-47c4-81d9-e4911e3d247f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:45:59.987296 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:59.987273 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da8ed147-5cc6-47c4-81d9-e4911e3d247f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:45:59.987371 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:45:59.987334 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da8ed147-5cc6-47c4-81d9-e4911e3d247f-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:00.087897 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:00.087868 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da8ed147-5cc6-47c4-81d9-e4911e3d247f-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:00.088088 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:00.087935 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da8ed147-5cc6-47c4-81d9-e4911e3d247f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:00.088088 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:00.087964 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vdcv\" (UniqueName: \"kubernetes.io/projected/da8ed147-5cc6-47c4-81d9-e4911e3d247f-kube-api-access-9vdcv\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:00.088088 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:00.087983 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da8ed147-5cc6-47c4-81d9-e4911e3d247f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:00.088088 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:00.088002 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8ed147-5cc6-47c4-81d9-e4911e3d247f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:00.088088 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:00.088025 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da8ed147-5cc6-47c4-81d9-e4911e3d247f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:00.088382 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:00.088363 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da8ed147-5cc6-47c4-81d9-e4911e3d247f-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:00.088455 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:00.088431 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da8ed147-5cc6-47c4-81d9-e4911e3d247f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:00.088504 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:00.088478 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da8ed147-5cc6-47c4-81d9-e4911e3d247f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:00.090498 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:00.090468 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da8ed147-5cc6-47c4-81d9-e4911e3d247f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:00.090661 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:00.090640 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8ed147-5cc6-47c4-81d9-e4911e3d247f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:00.106742 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:00.106719 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vdcv\" (UniqueName: \"kubernetes.io/projected/da8ed147-5cc6-47c4-81d9-e4911e3d247f-kube-api-access-9vdcv\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j\" (UID: \"da8ed147-5cc6-47c4-81d9-e4911e3d247f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:00.186313 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:00.186211 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:00.233911 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:00.233873 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:46:00.486160 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:00.486001 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j"] Oct 30 23:46:00.490139 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:46:00.490107 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda8ed147_5cc6_47c4_81d9_e4911e3d247f.slice/crio-2aba7d47490768991dab0d6621f4ee8500c2b8d4c4b8e1ab98b24c81cf6c511b WatchSource:0}: Error finding container 2aba7d47490768991dab0d6621f4ee8500c2b8d4c4b8e1ab98b24c81cf6c511b: Status 404 returned error can't find the container with id 2aba7d47490768991dab0d6621f4ee8500c2b8d4c4b8e1ab98b24c81cf6c511b Oct 30 23:46:01.269560 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:01.269516 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" event={"ID":"da8ed147-5cc6-47c4-81d9-e4911e3d247f","Type":"ContainerStarted","Data":"a5ba8ec1a917f1c92388ec3dba133858f73d328028823cad3af0abc74e8af288"} Oct 30 23:46:01.269732 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:01.269571 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" event={"ID":"da8ed147-5cc6-47c4-81d9-e4911e3d247f","Type":"ContainerStarted","Data":"2aba7d47490768991dab0d6621f4ee8500c2b8d4c4b8e1ab98b24c81cf6c511b"} Oct 30 23:46:01.311108 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:01.311027 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" podStartSLOduration=2.131486265 podStartE2EDuration="2.311008738s" totalImagesPullingTime="179.522473ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:01.310132968 +0000 UTC m=+649.574038541" watchObservedRunningTime="2026-10-30 23:46:01.311008738 +0000 UTC m=+649.574914311" Oct 30 23:46:02.186674 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:02.186643 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:05.324374 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:05.324344 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:46:05.336751 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:05.336718 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:46:06.310838 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:06.310814 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb" Oct 30 23:46:07.234272 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:07.234239 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:46:07.246543 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:07.246516 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:46:07.315717 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:07.315693 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-vjgt7" Oct 30 23:46:10.187340 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:10.187309 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:10.199643 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:10.199620 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:10.331499 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:10.331480 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j" Oct 30 23:46:12.823401 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:12.823368 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58c4849fbd-4mtxd"] Oct 30 23:46:12.828623 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:12.828598 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58c4849fbd-4mtxd" Oct 30 23:46:12.844481 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:12.844455 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58c4849fbd-4mtxd"] Oct 30 23:46:12.901409 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:12.901377 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/be48cd81-b2fa-41ec-83c6-8c5c3bac6c10-oidc-ca\") pod \"authorino-58c4849fbd-4mtxd\" (UID: \"be48cd81-b2fa-41ec-83c6-8c5c3bac6c10\") " pod="kuadrant-system/authorino-58c4849fbd-4mtxd" Oct 30 23:46:12.901533 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:12.901413 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be48cd81-b2fa-41ec-83c6-8c5c3bac6c10-tls-cert\") pod \"authorino-58c4849fbd-4mtxd\" (UID: \"be48cd81-b2fa-41ec-83c6-8c5c3bac6c10\") " pod="kuadrant-system/authorino-58c4849fbd-4mtxd" Oct 30 23:46:12.901533 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:12.901514 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dpz6\" (UniqueName: \"kubernetes.io/projected/be48cd81-b2fa-41ec-83c6-8c5c3bac6c10-kube-api-access-9dpz6\") pod \"authorino-58c4849fbd-4mtxd\" (UID: \"be48cd81-b2fa-41ec-83c6-8c5c3bac6c10\") " pod="kuadrant-system/authorino-58c4849fbd-4mtxd" Oct 30 23:46:13.002365 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:13.002336 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/be48cd81-b2fa-41ec-83c6-8c5c3bac6c10-oidc-ca\") pod \"authorino-58c4849fbd-4mtxd\" (UID: \"be48cd81-b2fa-41ec-83c6-8c5c3bac6c10\") " pod="kuadrant-system/authorino-58c4849fbd-4mtxd" Oct 30 23:46:13.002468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:13.002368 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be48cd81-b2fa-41ec-83c6-8c5c3bac6c10-tls-cert\") pod \"authorino-58c4849fbd-4mtxd\" (UID: \"be48cd81-b2fa-41ec-83c6-8c5c3bac6c10\") " pod="kuadrant-system/authorino-58c4849fbd-4mtxd" Oct 30 23:46:13.002468 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:13.002397 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dpz6\" (UniqueName: \"kubernetes.io/projected/be48cd81-b2fa-41ec-83c6-8c5c3bac6c10-kube-api-access-9dpz6\") pod \"authorino-58c4849fbd-4mtxd\" (UID: \"be48cd81-b2fa-41ec-83c6-8c5c3bac6c10\") " pod="kuadrant-system/authorino-58c4849fbd-4mtxd" Oct 30 23:46:13.002911 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:13.002892 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/be48cd81-b2fa-41ec-83c6-8c5c3bac6c10-oidc-ca\") pod \"authorino-58c4849fbd-4mtxd\" (UID: \"be48cd81-b2fa-41ec-83c6-8c5c3bac6c10\") " pod="kuadrant-system/authorino-58c4849fbd-4mtxd" Oct 30 23:46:13.004715 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:13.004699 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be48cd81-b2fa-41ec-83c6-8c5c3bac6c10-tls-cert\") pod \"authorino-58c4849fbd-4mtxd\" (UID: \"be48cd81-b2fa-41ec-83c6-8c5c3bac6c10\") " pod="kuadrant-system/authorino-58c4849fbd-4mtxd" Oct 30 23:46:13.020178 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:13.020159 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dpz6\" (UniqueName: \"kubernetes.io/projected/be48cd81-b2fa-41ec-83c6-8c5c3bac6c10-kube-api-access-9dpz6\") pod \"authorino-58c4849fbd-4mtxd\" (UID: \"be48cd81-b2fa-41ec-83c6-8c5c3bac6c10\") " pod="kuadrant-system/authorino-58c4849fbd-4mtxd" Oct 30 23:46:13.140341 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:13.140281 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58c4849fbd-4mtxd" Oct 30 23:46:13.436388 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:13.436316 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58c4849fbd-4mtxd"] Oct 30 23:46:13.440905 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:46:13.440877 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe48cd81_b2fa_41ec_83c6_8c5c3bac6c10.slice/crio-113f531d7e5069ac1e8f0e49ae81383abc1879cc203585af2a7a36a39be23614 WatchSource:0}: Error finding container 113f531d7e5069ac1e8f0e49ae81383abc1879cc203585af2a7a36a39be23614: Status 404 returned error can't find the container with id 113f531d7e5069ac1e8f0e49ae81383abc1879cc203585af2a7a36a39be23614 Oct 30 23:46:14.342350 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:14.342317 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58c4849fbd-4mtxd" event={"ID":"be48cd81-b2fa-41ec-83c6-8c5c3bac6c10","Type":"ContainerStarted","Data":"113f531d7e5069ac1e8f0e49ae81383abc1879cc203585af2a7a36a39be23614"} Oct 30 23:46:15.355840 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:15.355797 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58c4849fbd-4mtxd" event={"ID":"be48cd81-b2fa-41ec-83c6-8c5c3bac6c10","Type":"ContainerStarted","Data":"8e7591f555c6a6d1ccdc7e0524d8c747b2aa34c41dcd961e2d1ebdf050e97b0a"} Oct 30 23:46:15.393979 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:15.393918 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-58c4849fbd-4mtxd" podStartSLOduration=2.41471004 podStartE2EDuration="3.393899761s" totalImagesPullingTime="979.189721ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:15.393026778 +0000 UTC m=+663.656932352" watchObservedRunningTime="2026-10-30 23:46:15.393899761 +0000 UTC m=+663.657805334" Oct 30 23:46:15.450804 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:15.450765 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d8bfd975-tmbfp"] Oct 30 23:46:15.451025 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:15.450999 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6d8bfd975-tmbfp" podUID="ca9a3e7d-b296-47ed-883f-a7e014e93eec" containerName="authorino" containerID="cri-o://df4ee3230ac8fa66b8f271f9a38f887aa142a66ee452d3415087c693db40a1a5" gracePeriod=30 Oct 30 23:46:15.746117 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:15.746090 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d8bfd975-tmbfp" Oct 30 23:46:15.834773 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:15.834737 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ca9a3e7d-b296-47ed-883f-a7e014e93eec-tls-cert\" (UniqueName: \"kubernetes.io/secret/ca9a3e7d-b296-47ed-883f-a7e014e93eec-tls-cert\") pod \"ca9a3e7d-b296-47ed-883f-a7e014e93eec\" (UID: \"ca9a3e7d-b296-47ed-883f-a7e014e93eec\") " Oct 30 23:46:15.834952 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:15.834868 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca9a3e7d-b296-47ed-883f-a7e014e93eec-kube-api-access-22ddh\" (UniqueName: \"kubernetes.io/projected/ca9a3e7d-b296-47ed-883f-a7e014e93eec-kube-api-access-22ddh\") pod \"ca9a3e7d-b296-47ed-883f-a7e014e93eec\" (UID: \"ca9a3e7d-b296-47ed-883f-a7e014e93eec\") " Oct 30 23:46:15.834952 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:15.834902 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ca9a3e7d-b296-47ed-883f-a7e014e93eec-oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ca9a3e7d-b296-47ed-883f-a7e014e93eec-oidc-ca\") pod \"ca9a3e7d-b296-47ed-883f-a7e014e93eec\" (UID: \"ca9a3e7d-b296-47ed-883f-a7e014e93eec\") " Oct 30 23:46:15.837248 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:15.837215 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca9a3e7d-b296-47ed-883f-a7e014e93eec-kube-api-access-22ddh" pod "ca9a3e7d-b296-47ed-883f-a7e014e93eec" (UID: "ca9a3e7d-b296-47ed-883f-a7e014e93eec"). InnerVolumeSpecName "kube-api-access-22ddh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:46:15.842892 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:15.842865 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca9a3e7d-b296-47ed-883f-a7e014e93eec-oidc-ca" pod "ca9a3e7d-b296-47ed-883f-a7e014e93eec" (UID: "ca9a3e7d-b296-47ed-883f-a7e014e93eec"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:46:15.848719 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:15.848693 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca9a3e7d-b296-47ed-883f-a7e014e93eec-tls-cert" pod "ca9a3e7d-b296-47ed-883f-a7e014e93eec" (UID: "ca9a3e7d-b296-47ed-883f-a7e014e93eec"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:46:15.937744 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:15.937614 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22ddh\" (UniqueName: \"kubernetes.io/projected/ca9a3e7d-b296-47ed-883f-a7e014e93eec-kube-api-access-22ddh\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:46:15.937744 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:15.937653 5112 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ca9a3e7d-b296-47ed-883f-a7e014e93eec-oidc-ca\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:46:15.937744 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:15.937670 5112 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ca9a3e7d-b296-47ed-883f-a7e014e93eec-tls-cert\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:46:16.363703 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:16.363672 5112 generic.go:356] "Generic (PLEG): container finished" podID="ca9a3e7d-b296-47ed-883f-a7e014e93eec" containerID="df4ee3230ac8fa66b8f271f9a38f887aa142a66ee452d3415087c693db40a1a5" exitCode=0 Oct 30 23:46:16.364163 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:16.363724 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d8bfd975-tmbfp" Oct 30 23:46:16.364163 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:16.363768 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d8bfd975-tmbfp" event={"ID":"ca9a3e7d-b296-47ed-883f-a7e014e93eec","Type":"ContainerDied","Data":"df4ee3230ac8fa66b8f271f9a38f887aa142a66ee452d3415087c693db40a1a5"} Oct 30 23:46:16.364163 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:16.363825 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d8bfd975-tmbfp" event={"ID":"ca9a3e7d-b296-47ed-883f-a7e014e93eec","Type":"ContainerDied","Data":"964ad65d71dee8b362b71dc5e5f279053a05782a092b73988c13b97568fdf26f"} Oct 30 23:46:16.364163 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:16.363850 5112 scope.go:122] "RemoveContainer" containerID="df4ee3230ac8fa66b8f271f9a38f887aa142a66ee452d3415087c693db40a1a5" Oct 30 23:46:16.374723 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:16.374701 5112 scope.go:122] "RemoveContainer" containerID="df4ee3230ac8fa66b8f271f9a38f887aa142a66ee452d3415087c693db40a1a5" Oct 30 23:46:16.375080 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:46:16.375033 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df4ee3230ac8fa66b8f271f9a38f887aa142a66ee452d3415087c693db40a1a5\": container with ID starting with df4ee3230ac8fa66b8f271f9a38f887aa142a66ee452d3415087c693db40a1a5 not found: ID does not exist" containerID="df4ee3230ac8fa66b8f271f9a38f887aa142a66ee452d3415087c693db40a1a5" Oct 30 23:46:16.375167 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:16.375093 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df4ee3230ac8fa66b8f271f9a38f887aa142a66ee452d3415087c693db40a1a5"} err="failed to get container status \"df4ee3230ac8fa66b8f271f9a38f887aa142a66ee452d3415087c693db40a1a5\": rpc error: code = NotFound desc = could not find container \"df4ee3230ac8fa66b8f271f9a38f887aa142a66ee452d3415087c693db40a1a5\": container with ID starting with df4ee3230ac8fa66b8f271f9a38f887aa142a66ee452d3415087c693db40a1a5 not found: ID does not exist" Oct 30 23:46:16.420719 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:16.420688 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d8bfd975-tmbfp"] Oct 30 23:46:16.429550 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:16.429524 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d8bfd975-tmbfp"] Oct 30 23:46:17.863432 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.863388 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj"] Oct 30 23:46:17.863944 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.863850 5112 cpu_manager.go:414] "containerMap: removing container" podUID="ca9a3e7d-b296-47ed-883f-a7e014e93eec" containerName="authorino" Oct 30 23:46:17.863944 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.863861 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca9a3e7d-b296-47ed-883f-a7e014e93eec" containerName="authorino" Oct 30 23:46:17.864111 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.863960 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca9a3e7d-b296-47ed-883f-a7e014e93eec" containerName="authorino" Oct 30 23:46:17.867937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.867914 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:17.876211 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.876186 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ca9a3e7d-b296-47ed-883f-a7e014e93eec" path="/var/lib/kubelet/pods/ca9a3e7d-b296-47ed-883f-a7e014e93eec/volumes" Oct 30 23:46:17.882339 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.882318 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v"] Oct 30 23:46:17.886071 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.886051 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:17.891503 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.891480 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9g9s6\"" Oct 30 23:46:17.895110 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.895084 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj"] Oct 30 23:46:17.916061 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.915497 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v"] Oct 30 23:46:17.955753 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.955724 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18f1570-be63-490c-bc14-dde117281dcb-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:17.955948 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.955759 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:17.956027 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.955981 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:17.956112 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.956032 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:17.956343 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.956170 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:17.956343 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.956270 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:17.956343 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.956302 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc4qt\" (UniqueName: \"kubernetes.io/projected/a18f1570-be63-490c-bc14-dde117281dcb-kube-api-access-dc4qt\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:17.957498 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.956601 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18f1570-be63-490c-bc14-dde117281dcb-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:17.957498 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.956657 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18f1570-be63-490c-bc14-dde117281dcb-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:17.957498 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.956686 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18f1570-be63-490c-bc14-dde117281dcb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:17.957498 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.956756 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:17.957498 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.957461 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql5rq\" (UniqueName: \"kubernetes.io/projected/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-kube-api-access-ql5rq\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:17.957498 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.957492 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18f1570-be63-490c-bc14-dde117281dcb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:17.957848 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.957519 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:17.957848 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.957551 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18f1570-be63-490c-bc14-dde117281dcb-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:17.957848 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.957582 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18f1570-be63-490c-bc14-dde117281dcb-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:17.957848 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.957605 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18f1570-be63-490c-bc14-dde117281dcb-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:17.957848 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:17.957626 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.058415 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058382 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.058574 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058424 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.058574 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058452 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc4qt\" (UniqueName: \"kubernetes.io/projected/a18f1570-be63-490c-bc14-dde117281dcb-kube-api-access-dc4qt\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.058574 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058477 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18f1570-be63-490c-bc14-dde117281dcb-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.058574 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058503 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18f1570-be63-490c-bc14-dde117281dcb-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.058574 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058528 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18f1570-be63-490c-bc14-dde117281dcb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.058574 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058558 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.058907 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058586 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql5rq\" (UniqueName: \"kubernetes.io/projected/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-kube-api-access-ql5rq\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.058907 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058623 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18f1570-be63-490c-bc14-dde117281dcb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.058907 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058655 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.058907 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058687 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18f1570-be63-490c-bc14-dde117281dcb-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.058907 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058719 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18f1570-be63-490c-bc14-dde117281dcb-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.058907 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058757 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18f1570-be63-490c-bc14-dde117281dcb-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.058907 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058783 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.058907 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058818 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18f1570-be63-490c-bc14-dde117281dcb-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.058907 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058845 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.059441 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058912 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18f1570-be63-490c-bc14-dde117281dcb-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.059441 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058932 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.059441 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058939 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.059441 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.058963 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.059441 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.059014 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18f1570-be63-490c-bc14-dde117281dcb-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.059441 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.059019 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.059441 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.059352 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18f1570-be63-490c-bc14-dde117281dcb-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.059806 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.059622 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.059806 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.059637 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18f1570-be63-490c-bc14-dde117281dcb-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.059908 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.059834 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18f1570-be63-490c-bc14-dde117281dcb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.059972 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.059934 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.060092 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.060070 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.061438 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.061416 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18f1570-be63-490c-bc14-dde117281dcb-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.061901 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.061884 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18f1570-be63-490c-bc14-dde117281dcb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.061992 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.061885 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.062156 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.062137 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.077010 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.076926 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc4qt\" (UniqueName: \"kubernetes.io/projected/a18f1570-be63-490c-bc14-dde117281dcb-kube-api-access-dc4qt\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.078792 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.077379 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.078792 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.077447 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18f1570-be63-490c-bc14-dde117281dcb-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-7kbkj\" (UID: \"a18f1570-be63-490c-bc14-dde117281dcb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.078792 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.078685 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql5rq\" (UniqueName: \"kubernetes.io/projected/1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7-kube-api-access-ql5rq\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bkn8v\" (UID: \"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.186450 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.186365 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:18.204246 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.204205 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:18.520805 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.520772 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj"] Oct 30 23:46:18.525484 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:46:18.525461 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18f1570_be63_490c_bc14_dde117281dcb.slice/crio-6a9db7c3ec2d0f1b40679829f0bf9fae94058457bb7a241d4fdbae2b87d01958 WatchSource:0}: Error finding container 6a9db7c3ec2d0f1b40679829f0bf9fae94058457bb7a241d4fdbae2b87d01958: Status 404 returned error can't find the container with id 6a9db7c3ec2d0f1b40679829f0bf9fae94058457bb7a241d4fdbae2b87d01958 Oct 30 23:46:18.527845 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:46:18.527817 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d006dfd_c0c8_4a9b_9f3d_6248bb5102d7.slice/crio-62c764b9eeec108225cf364471421112092a5691a5c03efbab9ec226b0e9e4e0 WatchSource:0}: Error finding container 62c764b9eeec108225cf364471421112092a5691a5c03efbab9ec226b0e9e4e0: Status 404 returned error can't find the container with id 62c764b9eeec108225cf364471421112092a5691a5c03efbab9ec226b0e9e4e0 Oct 30 23:46:18.528407 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.528372 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:46:18.528488 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.528454 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:46:18.528528 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.528498 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:46:18.531319 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.531293 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:46:18.531420 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.531350 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:46:18.531420 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.531377 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:46:18.531707 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:18.531684 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v"] Oct 30 23:46:19.405028 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:19.404990 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" event={"ID":"a18f1570-be63-490c-bc14-dde117281dcb","Type":"ContainerStarted","Data":"f0fd5973250a7e13b9b693118e131b00c9af5228275266761d0b62fe9af43e4a"} Oct 30 23:46:19.409676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:19.409646 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" event={"ID":"a18f1570-be63-490c-bc14-dde117281dcb","Type":"ContainerStarted","Data":"6a9db7c3ec2d0f1b40679829f0bf9fae94058457bb7a241d4fdbae2b87d01958"} Oct 30 23:46:19.412698 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:19.412671 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" event={"ID":"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7","Type":"ContainerStarted","Data":"bec558ca2f8c969a6d99d2d37c4b2cb7a06dc4f7d87b2c37aa6ba7a03ee60afb"} Oct 30 23:46:19.412878 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:19.412861 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" event={"ID":"1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7","Type":"ContainerStarted","Data":"62c764b9eeec108225cf364471421112092a5691a5c03efbab9ec226b0e9e4e0"} Oct 30 23:46:19.481347 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:19.481286 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" podStartSLOduration=2.481266291 podStartE2EDuration="2.481266291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:19.469446009 +0000 UTC m=+667.733351582" watchObservedRunningTime="2026-10-30 23:46:19.481266291 +0000 UTC m=+667.745171865" Oct 30 23:46:20.202073 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:20.201827 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:20.202073 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:20.201944 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-7kbkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 23:46:20.202073 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:20.201993 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" podUID="a18f1570-be63-490c-bc14-dde117281dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 23:46:20.218057 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:20.215031 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:20.218057 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:20.215932 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bkn8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Oct 30 23:46:20.218057 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:20.215984 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" podUID="1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Oct 30 23:46:21.189065 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:21.188402 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-7kbkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 23:46:21.189065 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:21.188472 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" podUID="a18f1570-be63-490c-bc14-dde117281dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 23:46:21.209063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:21.207347 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bkn8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Oct 30 23:46:21.209063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:21.207397 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" podUID="1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Oct 30 23:46:22.188471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:22.188428 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-7kbkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 23:46:22.188858 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:22.188828 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" podUID="a18f1570-be63-490c-bc14-dde117281dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 23:46:22.206010 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:22.205977 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bkn8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Oct 30 23:46:22.206583 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:22.206554 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" podUID="1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Oct 30 23:46:23.024240 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:46:23.024161 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:46:23.199061 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:23.197337 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-7kbkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 23:46:23.199061 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:23.197399 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" podUID="a18f1570-be63-490c-bc14-dde117281dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 23:46:23.216942 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:23.216913 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bkn8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Oct 30 23:46:23.217544 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:23.217506 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" podUID="1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Oct 30 23:46:24.190261 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:24.190225 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-7kbkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 23:46:24.190536 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:24.190510 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" podUID="a18f1570-be63-490c-bc14-dde117281dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 23:46:24.206390 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:24.206360 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bkn8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Oct 30 23:46:24.206584 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:24.206561 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" podUID="1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Oct 30 23:46:25.187145 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:25.187106 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-7kbkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 23:46:25.187580 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:25.187167 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" podUID="a18f1570-be63-490c-bc14-dde117281dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 23:46:25.204855 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:25.204823 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bkn8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Oct 30 23:46:25.204965 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:25.204876 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" podUID="1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Oct 30 23:46:26.187818 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:26.187771 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-7kbkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 23:46:26.188362 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:26.187845 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" podUID="a18f1570-be63-490c-bc14-dde117281dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 23:46:26.981999 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:26.981966 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:26.982643 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:26.982618 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:26.983417 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:26.983399 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" Oct 30 23:46:27.036434 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:27.036395 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" podStartSLOduration=10.036380092 podStartE2EDuration="10.036380092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:19.527319693 +0000 UTC m=+667.791225302" watchObservedRunningTime="2026-10-30 23:46:27.036380092 +0000 UTC m=+675.300285665" Oct 30 23:46:27.191868 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:27.191842 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:27.192333 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:27.192250 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:27.192998 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:27.192982 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" Oct 30 23:46:32.928768 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:32.928733 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c"] Oct 30 23:46:32.935616 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:32.935598 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:32.959530 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:32.959498 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c"] Oct 30 23:46:32.987348 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:32.987321 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57eb85d4-61b3-424c-b0e6-5d2029938bcd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:32.987483 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:32.987429 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57eb85d4-61b3-424c-b0e6-5d2029938bcd-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:32.987535 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:32.987487 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57eb85d4-61b3-424c-b0e6-5d2029938bcd-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:32.987535 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:32.987509 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57eb85d4-61b3-424c-b0e6-5d2029938bcd-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:32.987623 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:32.987584 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57eb85d4-61b3-424c-b0e6-5d2029938bcd-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:32.987623 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:32.987610 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57eb85d4-61b3-424c-b0e6-5d2029938bcd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:32.987710 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:32.987649 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ktcf\" (UniqueName: \"kubernetes.io/projected/57eb85d4-61b3-424c-b0e6-5d2029938bcd-kube-api-access-9ktcf\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:32.987710 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:32.987693 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57eb85d4-61b3-424c-b0e6-5d2029938bcd-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:32.987845 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:32.987762 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57eb85d4-61b3-424c-b0e6-5d2029938bcd-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.089023 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.089000 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57eb85d4-61b3-424c-b0e6-5d2029938bcd-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.089163 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.089029 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57eb85d4-61b3-424c-b0e6-5d2029938bcd-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.089163 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.089072 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57eb85d4-61b3-424c-b0e6-5d2029938bcd-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.089163 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.089096 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57eb85d4-61b3-424c-b0e6-5d2029938bcd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.089163 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.089114 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ktcf\" (UniqueName: \"kubernetes.io/projected/57eb85d4-61b3-424c-b0e6-5d2029938bcd-kube-api-access-9ktcf\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.089163 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.089141 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57eb85d4-61b3-424c-b0e6-5d2029938bcd-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.089163 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.089161 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57eb85d4-61b3-424c-b0e6-5d2029938bcd-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.089474 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.089192 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57eb85d4-61b3-424c-b0e6-5d2029938bcd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.089474 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.089250 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57eb85d4-61b3-424c-b0e6-5d2029938bcd-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.089474 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.089406 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57eb85d4-61b3-424c-b0e6-5d2029938bcd-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.089474 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.089455 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57eb85d4-61b3-424c-b0e6-5d2029938bcd-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.089752 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.089733 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57eb85d4-61b3-424c-b0e6-5d2029938bcd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.089940 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.089917 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57eb85d4-61b3-424c-b0e6-5d2029938bcd-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.089940 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.089930 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57eb85d4-61b3-424c-b0e6-5d2029938bcd-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.091677 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.091653 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57eb85d4-61b3-424c-b0e6-5d2029938bcd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.091771 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.091709 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57eb85d4-61b3-424c-b0e6-5d2029938bcd-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.107121 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.107100 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57eb85d4-61b3-424c-b0e6-5d2029938bcd-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.107267 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.107250 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ktcf\" (UniqueName: \"kubernetes.io/projected/57eb85d4-61b3-424c-b0e6-5d2029938bcd-kube-api-access-9ktcf\") pod \"maas-default-gateway-openshift-default-7f5667f86c-rrg7c\" (UID: \"57eb85d4-61b3-424c-b0e6-5d2029938bcd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.251245 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.251225 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:33.580176 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.580153 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c"] Oct 30 23:46:33.581310 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:46:33.581287 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57eb85d4_61b3_424c_b0e6_5d2029938bcd.slice/crio-1b0f52d1dce9fce2b5f1525a7aa6ed466ae95919b034772c5bf5f94985c3b144 WatchSource:0}: Error finding container 1b0f52d1dce9fce2b5f1525a7aa6ed466ae95919b034772c5bf5f94985c3b144: Status 404 returned error can't find the container with id 1b0f52d1dce9fce2b5f1525a7aa6ed466ae95919b034772c5bf5f94985c3b144 Oct 30 23:46:33.583434 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.583405 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:46:33.583511 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.583467 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:46:33.583511 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:33.583491 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:46:34.523031 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:34.522991 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" event={"ID":"57eb85d4-61b3-424c-b0e6-5d2029938bcd","Type":"ContainerStarted","Data":"7726150ff9e40834d8bddb4bdff939e229f5db8b36f8e7329ed563e55dcafcee"} Oct 30 23:46:34.523031 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:34.523055 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" event={"ID":"57eb85d4-61b3-424c-b0e6-5d2029938bcd","Type":"ContainerStarted","Data":"1b0f52d1dce9fce2b5f1525a7aa6ed466ae95919b034772c5bf5f94985c3b144"} Oct 30 23:46:34.598839 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:34.598772 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" podStartSLOduration=2.598758799 podStartE2EDuration="2.598758799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:34.585495357 +0000 UTC m=+682.849400929" watchObservedRunningTime="2026-10-30 23:46:34.598758799 +0000 UTC m=+682.862664427" Oct 30 23:46:35.252176 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:35.252147 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:35.253731 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:35.253703 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-rrg7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Oct 30 23:46:35.253864 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:35.253749 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" podUID="57eb85d4-61b3-424c-b0e6-5d2029938bcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Oct 30 23:46:36.251642 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:36.251607 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-rrg7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Oct 30 23:46:36.252068 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:36.251669 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" podUID="57eb85d4-61b3-424c-b0e6-5d2029938bcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Oct 30 23:46:37.252397 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:37.252367 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-rrg7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Oct 30 23:46:37.252807 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:37.252413 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" podUID="57eb85d4-61b3-424c-b0e6-5d2029938bcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Oct 30 23:46:38.251717 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:38.251685 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-rrg7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Oct 30 23:46:38.251877 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:38.251738 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" podUID="57eb85d4-61b3-424c-b0e6-5d2029938bcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Oct 30 23:46:39.251909 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:39.251875 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-rrg7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Oct 30 23:46:39.252449 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:39.251931 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" podUID="57eb85d4-61b3-424c-b0e6-5d2029938bcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Oct 30 23:46:40.252358 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:40.252318 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-rrg7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Oct 30 23:46:40.252761 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:40.252361 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" podUID="57eb85d4-61b3-424c-b0e6-5d2029938bcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Oct 30 23:46:41.763168 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:41.763138 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:41.763652 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:41.763486 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:41.764267 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:41.764246 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" Oct 30 23:46:44.315823 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.315787 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp"] Oct 30 23:46:44.320957 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.320933 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.338434 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.338410 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp"] Oct 30 23:46:44.346158 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.346134 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-0147058d-model-kserve-self-signed-certs\"" Oct 30 23:46:44.394953 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.394926 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-tmp-dir\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.395101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.394994 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-model-cache\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.395176 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.395121 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-home\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.395232 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.395218 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/673b75e8-d040-49bf-9b39-6f6b7ab8d319-tls-certs\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.395270 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.395253 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgfbq\" (UniqueName: \"kubernetes.io/projected/673b75e8-d040-49bf-9b39-6f6b7ab8d319-kube-api-access-jgfbq\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.395307 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.395278 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-dshm\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.496113 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.496083 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-home\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.496583 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.496553 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-home\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.496883 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.496866 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/673b75e8-d040-49bf-9b39-6f6b7ab8d319-tls-certs\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.496941 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.496912 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgfbq\" (UniqueName: \"kubernetes.io/projected/673b75e8-d040-49bf-9b39-6f6b7ab8d319-kube-api-access-jgfbq\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.497002 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.496948 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-dshm\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.497002 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.496981 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-tmp-dir\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.497121 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.497106 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-model-cache\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.497444 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.497422 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-model-cache\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.497663 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.497647 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-tmp-dir\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.502568 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.502546 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/673b75e8-d040-49bf-9b39-6f6b7ab8d319-tls-certs\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.504291 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.504267 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-dshm\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.517850 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.517826 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgfbq\" (UniqueName: \"kubernetes.io/projected/673b75e8-d040-49bf-9b39-6f6b7ab8d319-kube-api-access-jgfbq\") pod \"grid-inv-0147058d-model-kserve-f76854b59-k7smp\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.634445 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.634382 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:44.929815 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:44.929735 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp"] Oct 30 23:46:44.935474 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:46:44.935448 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod673b75e8_d040_49bf_9b39_6f6b7ab8d319.slice/crio-b20e1d2c9a5680024a89bd73a4aeed93edfbdb0f603f05a88428f49eef0922f8 WatchSource:0}: Error finding container b20e1d2c9a5680024a89bd73a4aeed93edfbdb0f603f05a88428f49eef0922f8: Status 404 returned error can't find the container with id b20e1d2c9a5680024a89bd73a4aeed93edfbdb0f603f05a88428f49eef0922f8 Oct 30 23:46:45.589521 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:45.589485 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" event={"ID":"673b75e8-d040-49bf-9b39-6f6b7ab8d319","Type":"ContainerStarted","Data":"3faf34b11203ed0b537d81392b28cd0c5e1c843a64631aaafbc434ab8c28b56d"} Oct 30 23:46:45.589907 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:45.589533 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" event={"ID":"673b75e8-d040-49bf-9b39-6f6b7ab8d319","Type":"ContainerStarted","Data":"b20e1d2c9a5680024a89bd73a4aeed93edfbdb0f603f05a88428f49eef0922f8"} Oct 30 23:46:45.627672 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:45.627613 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" podStartSLOduration=1.627596429 podStartE2EDuration="1.627596429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:45.627008103 +0000 UTC m=+693.890913672" watchObservedRunningTime="2026-10-30 23:46:45.627596429 +0000 UTC m=+693.891502003" Oct 30 23:46:45.635133 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:45.635109 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:52.534117 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.534085 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr"] Oct 30 23:46:52.539835 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.539812 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.569145 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.568730 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-0147058d-unmatched-kserve-self-signed-certs\"" Oct 30 23:46:52.572126 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.572103 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr"] Oct 30 23:46:52.591622 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.591591 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbprw\" (UniqueName: \"kubernetes.io/projected/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-kube-api-access-kbprw\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.591731 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.591706 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-tmp-dir\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.591787 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.591738 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-dshm\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.591830 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.591799 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-home\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.591830 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.591820 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-tls-certs\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.591931 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.591898 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-model-cache\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.692656 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.692628 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-tmp-dir\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.692789 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.692663 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-dshm\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.692789 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.692732 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-home\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.692789 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.692749 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-tls-certs\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.692789 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.692769 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-model-cache\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.692976 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.692837 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbprw\" (UniqueName: \"kubernetes.io/projected/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-kube-api-access-kbprw\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.693103 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.693079 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-tmp-dir\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.693247 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.693168 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-home\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.693327 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.693303 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-model-cache\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.694890 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.694865 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-dshm\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.695220 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.695202 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-tls-certs\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.711384 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.711359 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbprw\" (UniqueName: \"kubernetes.io/projected/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-kube-api-access-kbprw\") pod \"grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.852697 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:52.852621 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:52.975566 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:46:52.975521 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:46:53.149412 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:53.149344 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr"] Oct 30 23:46:53.152673 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:46:53.152642 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3914cfc2_5909_4c06_ab58_acf7cfe2fb3e.slice/crio-77162ef7a6cfe10fcfe4e276744e0b627f7bcb36ac02d73e030796429d4d61e7 WatchSource:0}: Error finding container 77162ef7a6cfe10fcfe4e276744e0b627f7bcb36ac02d73e030796429d4d61e7: Status 404 returned error can't find the container with id 77162ef7a6cfe10fcfe4e276744e0b627f7bcb36ac02d73e030796429d4d61e7 Oct 30 23:46:53.654685 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:53.654649 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" event={"ID":"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e","Type":"ContainerStarted","Data":"8b8e27220a7811cf4906a5adbd7ef1e98a96d9d2adb41ef71ad878b661c2ca51"} Oct 30 23:46:53.654685 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:53.654691 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" event={"ID":"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e","Type":"ContainerStarted","Data":"77162ef7a6cfe10fcfe4e276744e0b627f7bcb36ac02d73e030796429d4d61e7"} Oct 30 23:46:53.693927 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:53.693881 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" podStartSLOduration=1.693867601 podStartE2EDuration="1.693867601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:53.691495046 +0000 UTC m=+701.955400641" watchObservedRunningTime="2026-10-30 23:46:53.693867601 +0000 UTC m=+701.957773173" Oct 30 23:46:53.853490 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:53.853460 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:46:54.635345 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:54.635312 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:54.648477 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:54.648447 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:54.672228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:54.672201 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:46:57.831068 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:57.827135 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-rrg7c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:46:57.831068 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:57.827198 5112 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" podUID="57eb85d4-61b3-424c-b0e6-5d2029938bcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:46:58.037201 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:58.037156 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bkn8v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:46:58.037402 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:58.037236 5112 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" podUID="1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:46:58.245115 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:58.244129 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-7kbkj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:46:58.245115 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:46:58.244193 5112 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" podUID="a18f1570-be63-490c-bc14-dde117281dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:47:02.853501 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:47:02.853472 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:47:02.865886 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:47:02.865862 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:47:03.749358 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:47:03.749327 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:47:23.052142 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:47:23.052092 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:47:27.817158 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:47:27.817120 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-rrg7c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:47:27.817847 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:47:27.817812 5112 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" podUID="57eb85d4-61b3-424c-b0e6-5d2029938bcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:47:28.030191 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:47:28.030138 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bkn8v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:47:28.030498 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:47:28.030453 5112 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" podUID="1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:47:28.246266 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:47:28.246167 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-7kbkj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:47:28.246266 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:47:28.246243 5112 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" podUID="a18f1570-be63-490c-bc14-dde117281dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:47:43.040232 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:47:43.040191 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bkn8v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:47:43.040730 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:47:43.040269 5112 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" podUID="1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:47:43.255422 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:47:43.255108 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-7kbkj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:47:43.255422 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:47:43.255154 5112 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" podUID="a18f1570-be63-490c-bc14-dde117281dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:47:53.051777 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:47:53.051572 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:48:03.151066 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:03.086150 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp"] Oct 30 23:48:09.332464 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:09.332327 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr"] Oct 30 23:48:13.250179 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:13.250136 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-7kbkj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:48:13.250657 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:13.250202 5112 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7kbkj" podUID="a18f1570-be63-490c-bc14-dde117281dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:48:16.582506 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.582465 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk"] Oct 30 23:48:16.587391 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.587363 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.601939 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.601911 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-38e303fb-model-kserve-self-signed-certs\"" Oct 30 23:48:16.606760 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.606732 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk"] Oct 30 23:48:16.681657 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.681627 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-model-cache\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.681802 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.681666 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d800ac50-6129-44a5-993e-ad627159b180-tls-certs\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.681802 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.681760 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nhxm\" (UniqueName: \"kubernetes.io/projected/d800ac50-6129-44a5-993e-ad627159b180-kube-api-access-8nhxm\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.681890 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.681820 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-home\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.681890 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.681867 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-tmp-dir\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.681959 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.681902 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-dshm\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.783128 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.783092 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-model-cache\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.783875 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.783134 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d800ac50-6129-44a5-993e-ad627159b180-tls-certs\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.783875 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.783177 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nhxm\" (UniqueName: \"kubernetes.io/projected/d800ac50-6129-44a5-993e-ad627159b180-kube-api-access-8nhxm\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.783875 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.783208 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-home\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.783875 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.783259 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-tmp-dir\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.783875 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.783315 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-dshm\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.783875 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.783658 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-home\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.783875 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.783780 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-tmp-dir\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.784354 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.783932 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-model-cache\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.786145 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.786116 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-dshm\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.787267 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.787248 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d800ac50-6129-44a5-993e-ad627159b180-tls-certs\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.801026 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.801003 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nhxm\" (UniqueName: \"kubernetes.io/projected/d800ac50-6129-44a5-993e-ad627159b180-kube-api-access-8nhxm\") pod \"grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:16.914091 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:16.914002 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:17.208270 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:17.208201 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk"] Oct 30 23:48:17.212691 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:48:17.212664 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd800ac50_6129_44a5_993e_ad627159b180.slice/crio-d0bc5fef08d2c657dc6ed2d40cdfa71ec5e49b904c7e32f4cda78ef1b3ed64a4 WatchSource:0}: Error finding container d0bc5fef08d2c657dc6ed2d40cdfa71ec5e49b904c7e32f4cda78ef1b3ed64a4: Status 404 returned error can't find the container with id d0bc5fef08d2c657dc6ed2d40cdfa71ec5e49b904c7e32f4cda78ef1b3ed64a4 Oct 30 23:48:17.378382 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:17.378350 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" event={"ID":"d800ac50-6129-44a5-993e-ad627159b180","Type":"ContainerStarted","Data":"26aa4df92d181c98ef9a7f29225b5e9025076697e30b999e808b5dbff4270bb1"} Oct 30 23:48:17.378545 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:17.378390 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" event={"ID":"d800ac50-6129-44a5-993e-ad627159b180","Type":"ContainerStarted","Data":"d0bc5fef08d2c657dc6ed2d40cdfa71ec5e49b904c7e32f4cda78ef1b3ed64a4"} Oct 30 23:48:17.416134 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:17.416090 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" podStartSLOduration=1.416077739 podStartE2EDuration="1.416077739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:17.414392749 +0000 UTC m=+785.678298320" watchObservedRunningTime="2026-10-30 23:48:17.416077739 +0000 UTC m=+785.679983310" Oct 30 23:48:17.914108 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:17.914078 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:18.362821 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.362786 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" podUID="673b75e8-d040-49bf-9b39-6f6b7ab8d319" containerName="main" containerID="cri-o://3faf34b11203ed0b537d81392b28cd0c5e1c843a64631aaafbc434ab8c28b56d" gracePeriod=45 Oct 30 23:48:18.629442 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.629387 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:48:18.703339 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.703303 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-dshm\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-dshm\") pod \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " Oct 30 23:48:18.703487 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.703371 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-tmp-dir\") pod \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " Oct 30 23:48:18.703487 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.703422 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/673b75e8-d040-49bf-9b39-6f6b7ab8d319-kube-api-access-jgfbq\" (UniqueName: \"kubernetes.io/projected/673b75e8-d040-49bf-9b39-6f6b7ab8d319-kube-api-access-jgfbq\") pod \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " Oct 30 23:48:18.703611 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.703549 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/673b75e8-d040-49bf-9b39-6f6b7ab8d319-tls-certs\" (UniqueName: \"kubernetes.io/secret/673b75e8-d040-49bf-9b39-6f6b7ab8d319-tls-certs\") pod \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " Oct 30 23:48:18.703611 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.703589 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-home\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-home\") pod \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " Oct 30 23:48:18.703720 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.703647 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-model-cache\") pod \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\" (UID: \"673b75e8-d040-49bf-9b39-6f6b7ab8d319\") " Oct 30 23:48:18.703720 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.703661 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-tmp-dir" pod "673b75e8-d040-49bf-9b39-6f6b7ab8d319" (UID: "673b75e8-d040-49bf-9b39-6f6b7ab8d319"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:48:18.704124 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.703886 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-home" pod "673b75e8-d040-49bf-9b39-6f6b7ab8d319" (UID: "673b75e8-d040-49bf-9b39-6f6b7ab8d319"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:48:18.704124 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.704060 5112 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-tmp-dir\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:48:18.704124 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.704081 5112 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-home\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:48:18.704124 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.704080 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-model-cache" pod "673b75e8-d040-49bf-9b39-6f6b7ab8d319" (UID: "673b75e8-d040-49bf-9b39-6f6b7ab8d319"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:48:18.705902 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.705874 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/673b75e8-d040-49bf-9b39-6f6b7ab8d319-kube-api-access-jgfbq" pod "673b75e8-d040-49bf-9b39-6f6b7ab8d319" (UID: "673b75e8-d040-49bf-9b39-6f6b7ab8d319"). InnerVolumeSpecName "kube-api-access-jgfbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:48:18.706204 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.706178 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/673b75e8-d040-49bf-9b39-6f6b7ab8d319-tls-certs" pod "673b75e8-d040-49bf-9b39-6f6b7ab8d319" (UID: "673b75e8-d040-49bf-9b39-6f6b7ab8d319"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:48:18.706335 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.706315 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-dshm" pod "673b75e8-d040-49bf-9b39-6f6b7ab8d319" (UID: "673b75e8-d040-49bf-9b39-6f6b7ab8d319"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:48:18.805288 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.805266 5112 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/673b75e8-d040-49bf-9b39-6f6b7ab8d319-tls-certs\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:48:18.805388 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.805289 5112 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-model-cache\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:48:18.805388 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.805309 5112 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/673b75e8-d040-49bf-9b39-6f6b7ab8d319-dshm\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:48:18.805388 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:18.805317 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgfbq\" (UniqueName: \"kubernetes.io/projected/673b75e8-d040-49bf-9b39-6f6b7ab8d319-kube-api-access-jgfbq\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:48:19.178280 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.178244 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw"] Oct 30 23:48:19.179018 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.178998 5112 cpu_manager.go:414] "containerMap: removing container" podUID="673b75e8-d040-49bf-9b39-6f6b7ab8d319" containerName="main" Oct 30 23:48:19.179087 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.179022 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="673b75e8-d040-49bf-9b39-6f6b7ab8d319" containerName="main" Oct 30 23:48:19.179213 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.179200 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="673b75e8-d040-49bf-9b39-6f6b7ab8d319" containerName="main" Oct 30 23:48:19.183093 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.183070 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.201593 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.201570 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw"] Oct 30 23:48:19.209597 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.209572 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-38e303fb-unmatched-kserve-self-signed-certs\"" Oct 30 23:48:19.312089 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.311387 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-model-cache\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.312089 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.311439 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-tmp-dir\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.312089 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.311488 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqx2z\" (UniqueName: \"kubernetes.io/projected/4298b1ed-afe8-4077-9899-5cc8a00d8c73-kube-api-access-jqx2z\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.312089 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.311524 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-dshm\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.312089 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.311604 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-home\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.312089 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.311742 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4298b1ed-afe8-4077-9899-5cc8a00d8c73-tls-certs\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.391951 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.391917 5112 generic.go:356] "Generic (PLEG): container finished" podID="673b75e8-d040-49bf-9b39-6f6b7ab8d319" containerID="3faf34b11203ed0b537d81392b28cd0c5e1c843a64631aaafbc434ab8c28b56d" exitCode=0 Oct 30 23:48:19.392180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.391965 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" Oct 30 23:48:19.392180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.391996 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" event={"ID":"673b75e8-d040-49bf-9b39-6f6b7ab8d319","Type":"ContainerDied","Data":"3faf34b11203ed0b537d81392b28cd0c5e1c843a64631aaafbc434ab8c28b56d"} Oct 30 23:48:19.392180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.392072 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp" event={"ID":"673b75e8-d040-49bf-9b39-6f6b7ab8d319","Type":"ContainerDied","Data":"b20e1d2c9a5680024a89bd73a4aeed93edfbdb0f603f05a88428f49eef0922f8"} Oct 30 23:48:19.392180 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.392085 5112 scope.go:122] "RemoveContainer" containerID="3faf34b11203ed0b537d81392b28cd0c5e1c843a64631aaafbc434ab8c28b56d" Oct 30 23:48:19.407768 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.407734 5112 scope.go:122] "RemoveContainer" containerID="3faf34b11203ed0b537d81392b28cd0c5e1c843a64631aaafbc434ab8c28b56d" Oct 30 23:48:19.408496 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:48:19.408419 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3faf34b11203ed0b537d81392b28cd0c5e1c843a64631aaafbc434ab8c28b56d\": container with ID starting with 3faf34b11203ed0b537d81392b28cd0c5e1c843a64631aaafbc434ab8c28b56d not found: ID does not exist" containerID="3faf34b11203ed0b537d81392b28cd0c5e1c843a64631aaafbc434ab8c28b56d" Oct 30 23:48:19.408496 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.408456 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3faf34b11203ed0b537d81392b28cd0c5e1c843a64631aaafbc434ab8c28b56d"} err="failed to get container status \"3faf34b11203ed0b537d81392b28cd0c5e1c843a64631aaafbc434ab8c28b56d\": rpc error: code = NotFound desc = could not find container \"3faf34b11203ed0b537d81392b28cd0c5e1c843a64631aaafbc434ab8c28b56d\": container with ID starting with 3faf34b11203ed0b537d81392b28cd0c5e1c843a64631aaafbc434ab8c28b56d not found: ID does not exist" Oct 30 23:48:19.413114 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.413081 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4298b1ed-afe8-4077-9899-5cc8a00d8c73-tls-certs\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.413206 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.413169 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-model-cache\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.413259 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.413213 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-tmp-dir\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.413316 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.413257 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqx2z\" (UniqueName: \"kubernetes.io/projected/4298b1ed-afe8-4077-9899-5cc8a00d8c73-kube-api-access-jqx2z\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.413316 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.413289 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-dshm\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.413422 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.413364 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-home\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.413638 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.413619 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-model-cache\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.413719 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.413702 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-home\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.413936 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.413919 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-tmp-dir\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.415673 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.415647 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-dshm\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.415673 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.415662 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4298b1ed-afe8-4077-9899-5cc8a00d8c73-tls-certs\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.435796 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.435741 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqx2z\" (UniqueName: \"kubernetes.io/projected/4298b1ed-afe8-4077-9899-5cc8a00d8c73-kube-api-access-jqx2z\") pod \"grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.444747 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.444725 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp"] Oct 30 23:48:19.452513 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.452492 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-0147058d-model-kserve-f76854b59-k7smp"] Oct 30 23:48:19.497471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.497210 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:19.845293 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.843653 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw"] Oct 30 23:48:19.849081 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:48:19.847640 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4298b1ed_afe8_4077_9899_5cc8a00d8c73.slice/crio-29ec779f4b76a9a71125abd495c7823c9cea34faead0e7eaa87df37387096c01 WatchSource:0}: Error finding container 29ec779f4b76a9a71125abd495c7823c9cea34faead0e7eaa87df37387096c01: Status 404 returned error can't find the container with id 29ec779f4b76a9a71125abd495c7823c9cea34faead0e7eaa87df37387096c01 Oct 30 23:48:19.886784 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:19.886755 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="673b75e8-d040-49bf-9b39-6f6b7ab8d319" path="/var/lib/kubelet/pods/673b75e8-d040-49bf-9b39-6f6b7ab8d319/volumes" Oct 30 23:48:20.402630 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:20.402583 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" event={"ID":"4298b1ed-afe8-4077-9899-5cc8a00d8c73","Type":"ContainerStarted","Data":"86a9419650fd1260211ceb7fdf0eb5edef21ea6c55ad1b9e1683ac653a84b1fe"} Oct 30 23:48:20.403204 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:20.402654 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" event={"ID":"4298b1ed-afe8-4077-9899-5cc8a00d8c73","Type":"ContainerStarted","Data":"29ec779f4b76a9a71125abd495c7823c9cea34faead0e7eaa87df37387096c01"} Oct 30 23:48:20.442731 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:20.442662 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" podStartSLOduration=1.442644163 podStartE2EDuration="1.442644163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:20.441459744 +0000 UTC m=+788.705365328" watchObservedRunningTime="2026-10-30 23:48:20.442644163 +0000 UTC m=+788.706549736" Oct 30 23:48:20.497647 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:20.497619 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:22.980095 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:48:22.980057 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:48:24.358766 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.358728 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" podUID="3914cfc2-5909-4c06-ab58-acf7cfe2fb3e" containerName="main" containerID="cri-o://8b8e27220a7811cf4906a5adbd7ef1e98a96d9d2adb41ef71ad878b661c2ca51" gracePeriod=45 Oct 30 23:48:24.665998 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.665971 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:48:24.684846 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.684821 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-tmp-dir\") pod \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " Oct 30 23:48:24.684955 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.684883 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-dshm\") pod \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " Oct 30 23:48:24.684955 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.684916 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-model-cache\") pod \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " Oct 30 23:48:24.685462 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.685073 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-kube-api-access-kbprw\" (UniqueName: \"kubernetes.io/projected/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-kube-api-access-kbprw\") pod \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " Oct 30 23:48:24.685462 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.685170 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-tls-certs\" (UniqueName: \"kubernetes.io/secret/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-tls-certs\") pod \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " Oct 30 23:48:24.685462 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.685183 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-tmp-dir" pod "3914cfc2-5909-4c06-ab58-acf7cfe2fb3e" (UID: "3914cfc2-5909-4c06-ab58-acf7cfe2fb3e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:48:24.685462 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.685217 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-home\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-home\") pod \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\" (UID: \"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e\") " Oct 30 23:48:24.685462 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.685298 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-model-cache" pod "3914cfc2-5909-4c06-ab58-acf7cfe2fb3e" (UID: "3914cfc2-5909-4c06-ab58-acf7cfe2fb3e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:48:24.685788 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.685470 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-home" pod "3914cfc2-5909-4c06-ab58-acf7cfe2fb3e" (UID: "3914cfc2-5909-4c06-ab58-acf7cfe2fb3e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:48:24.685788 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.685629 5112 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-home\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:48:24.685788 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.685649 5112 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-tmp-dir\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:48:24.685788 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.685664 5112 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-model-cache\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:48:24.687434 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.687411 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-dshm" pod "3914cfc2-5909-4c06-ab58-acf7cfe2fb3e" (UID: "3914cfc2-5909-4c06-ab58-acf7cfe2fb3e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:48:24.689515 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.689485 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-tls-certs" pod "3914cfc2-5909-4c06-ab58-acf7cfe2fb3e" (UID: "3914cfc2-5909-4c06-ab58-acf7cfe2fb3e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:48:24.694589 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.694554 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-kube-api-access-kbprw" pod "3914cfc2-5909-4c06-ab58-acf7cfe2fb3e" (UID: "3914cfc2-5909-4c06-ab58-acf7cfe2fb3e"). InnerVolumeSpecName "kube-api-access-kbprw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:48:24.798063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.797672 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbprw\" (UniqueName: \"kubernetes.io/projected/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-kube-api-access-kbprw\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:48:24.798063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.797712 5112 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-tls-certs\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:48:24.798063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:24.797728 5112 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e-dshm\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:48:25.480064 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:25.478098 5112 generic.go:356] "Generic (PLEG): container finished" podID="3914cfc2-5909-4c06-ab58-acf7cfe2fb3e" containerID="8b8e27220a7811cf4906a5adbd7ef1e98a96d9d2adb41ef71ad878b661c2ca51" exitCode=0 Oct 30 23:48:25.480064 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:25.478216 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" event={"ID":"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e","Type":"ContainerDied","Data":"8b8e27220a7811cf4906a5adbd7ef1e98a96d9d2adb41ef71ad878b661c2ca51"} Oct 30 23:48:25.480064 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:25.478256 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" event={"ID":"3914cfc2-5909-4c06-ab58-acf7cfe2fb3e","Type":"ContainerDied","Data":"77162ef7a6cfe10fcfe4e276744e0b627f7bcb36ac02d73e030796429d4d61e7"} Oct 30 23:48:25.480064 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:25.478280 5112 scope.go:122] "RemoveContainer" containerID="8b8e27220a7811cf4906a5adbd7ef1e98a96d9d2adb41ef71ad878b661c2ca51" Oct 30 23:48:25.480064 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:25.478424 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr" Oct 30 23:48:25.554399 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:25.554294 5112 scope.go:122] "RemoveContainer" containerID="8b8e27220a7811cf4906a5adbd7ef1e98a96d9d2adb41ef71ad878b661c2ca51" Oct 30 23:48:25.554651 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:48:25.554625 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b8e27220a7811cf4906a5adbd7ef1e98a96d9d2adb41ef71ad878b661c2ca51\": container with ID starting with 8b8e27220a7811cf4906a5adbd7ef1e98a96d9d2adb41ef71ad878b661c2ca51 not found: ID does not exist" containerID="8b8e27220a7811cf4906a5adbd7ef1e98a96d9d2adb41ef71ad878b661c2ca51" Oct 30 23:48:25.554745 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:25.554665 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b8e27220a7811cf4906a5adbd7ef1e98a96d9d2adb41ef71ad878b661c2ca51"} err="failed to get container status \"8b8e27220a7811cf4906a5adbd7ef1e98a96d9d2adb41ef71ad878b661c2ca51\": rpc error: code = NotFound desc = could not find container \"8b8e27220a7811cf4906a5adbd7ef1e98a96d9d2adb41ef71ad878b661c2ca51\": container with ID starting with 8b8e27220a7811cf4906a5adbd7ef1e98a96d9d2adb41ef71ad878b661c2ca51 not found: ID does not exist" Oct 30 23:48:25.608071 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:25.596085 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr"] Oct 30 23:48:25.608071 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:25.596699 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-0147058d-unmatched-kserve-5f8b6f5777-tt4pr"] Oct 30 23:48:25.897063 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:25.896990 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3914cfc2-5909-4c06-ab58-acf7cfe2fb3e" path="/var/lib/kubelet/pods/3914cfc2-5909-4c06-ab58-acf7cfe2fb3e/volumes" Oct 30 23:48:26.914503 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:26.914473 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:26.934538 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:26.934508 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:27.517057 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:27.517016 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:48:29.497643 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:29.497605 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:29.511410 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:29.511381 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:29.527744 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:29.527722 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:48:33.020886 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:33.020845 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9517-770b78"] Oct 30 23:48:33.021427 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:33.021408 5112 cpu_manager.go:414] "containerMap: removing container" podUID="3914cfc2-5909-4c06-ab58-acf7cfe2fb3e" containerName="main" Oct 30 23:48:33.021474 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:33.021428 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3914cfc2-5909-4c06-ab58-acf7cfe2fb3e" containerName="main" Oct 30 23:48:33.021576 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:33.021565 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="3914cfc2-5909-4c06-ab58-acf7cfe2fb3e" containerName="main" Oct 30 23:48:33.024727 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:33.024703 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9517-770b78" Oct 30 23:48:33.042657 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:33.042619 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9517-770b78"] Oct 30 23:48:33.123730 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:33.123702 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vj65\" (UniqueName: \"kubernetes.io/projected/c7621a1d-707f-4ae7-8d7e-e34b93b47f13-kube-api-access-5vj65\") pod \"test-curl-9517-770b78\" (UID: \"c7621a1d-707f-4ae7-8d7e-e34b93b47f13\") " pod="opendatahub/test-curl-9517-770b78" Oct 30 23:48:33.224606 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:33.224582 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vj65\" (UniqueName: \"kubernetes.io/projected/c7621a1d-707f-4ae7-8d7e-e34b93b47f13-kube-api-access-5vj65\") pod \"test-curl-9517-770b78\" (UID: \"c7621a1d-707f-4ae7-8d7e-e34b93b47f13\") " pod="opendatahub/test-curl-9517-770b78" Oct 30 23:48:33.242842 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:33.242817 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vj65\" (UniqueName: \"kubernetes.io/projected/c7621a1d-707f-4ae7-8d7e-e34b93b47f13-kube-api-access-5vj65\") pod \"test-curl-9517-770b78\" (UID: \"c7621a1d-707f-4ae7-8d7e-e34b93b47f13\") " pod="opendatahub/test-curl-9517-770b78" Oct 30 23:48:33.352104 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:33.352056 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9517-770b78" Oct 30 23:48:33.644467 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:33.644388 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9517-770b78"] Oct 30 23:48:33.648314 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:48:33.648284 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7621a1d_707f_4ae7_8d7e_e34b93b47f13.slice/crio-887ed7c077a449b61f331626dc0a760680739d1b1b6f2d4961566c0d806eb4de WatchSource:0}: Error finding container 887ed7c077a449b61f331626dc0a760680739d1b1b6f2d4961566c0d806eb4de: Status 404 returned error can't find the container with id 887ed7c077a449b61f331626dc0a760680739d1b1b6f2d4961566c0d806eb4de Oct 30 23:48:34.544399 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:34.544368 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9517-770b78" event={"ID":"c7621a1d-707f-4ae7-8d7e-e34b93b47f13","Type":"ContainerStarted","Data":"6c3e14fe41b392094b67ba85223db7bd21fed32962763197f265651aa8c466e5"} Oct 30 23:48:34.544776 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:34.544410 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9517-770b78" event={"ID":"c7621a1d-707f-4ae7-8d7e-e34b93b47f13","Type":"ContainerStarted","Data":"887ed7c077a449b61f331626dc0a760680739d1b1b6f2d4961566c0d806eb4de"} Oct 30 23:48:35.527501 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:35.527451 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-9517-770b78" podStartSLOduration=1.980875541 podStartE2EDuration="2.527438601s" totalImagesPullingTime="546.56306ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:34.578956659 +0000 UTC m=+802.842862233" watchObservedRunningTime="2026-10-30 23:48:35.527438601 +0000 UTC m=+803.791344173" Oct 30 23:48:35.528290 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:35.528272 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9517-770b78"] Oct 30 23:48:35.534288 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:35.534258 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9517-770b78"] Oct 30 23:48:35.906472 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:35.906395 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9517-1eb0f1"] Oct 30 23:48:35.906851 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:35.906836 5112 cpu_manager.go:414] "containerMap: removing container" podUID="c7621a1d-707f-4ae7-8d7e-e34b93b47f13" containerName="test-curl-9517-770b78" Oct 30 23:48:35.906894 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:35.906851 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c7621a1d-707f-4ae7-8d7e-e34b93b47f13" containerName="test-curl-9517-770b78" Oct 30 23:48:35.906973 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:35.906963 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="c7621a1d-707f-4ae7-8d7e-e34b93b47f13" containerName="test-curl-9517-770b78" Oct 30 23:48:35.910357 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:35.910339 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9517-1eb0f1" Oct 30 23:48:35.925443 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:35.925421 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9517-1eb0f1"] Oct 30 23:48:35.945590 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:35.945563 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fhh5\" (UniqueName: \"kubernetes.io/projected/bd198dc0-589d-4d42-9062-c3b267f6e2f1-kube-api-access-2fhh5\") pod \"test-curl-9517-1eb0f1\" (UID: \"bd198dc0-589d-4d42-9062-c3b267f6e2f1\") " pod="opendatahub/test-curl-9517-1eb0f1" Oct 30 23:48:36.046061 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:36.046018 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fhh5\" (UniqueName: \"kubernetes.io/projected/bd198dc0-589d-4d42-9062-c3b267f6e2f1-kube-api-access-2fhh5\") pod \"test-curl-9517-1eb0f1\" (UID: \"bd198dc0-589d-4d42-9062-c3b267f6e2f1\") " pod="opendatahub/test-curl-9517-1eb0f1" Oct 30 23:48:36.066067 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:36.066019 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fhh5\" (UniqueName: \"kubernetes.io/projected/bd198dc0-589d-4d42-9062-c3b267f6e2f1-kube-api-access-2fhh5\") pod \"test-curl-9517-1eb0f1\" (UID: \"bd198dc0-589d-4d42-9062-c3b267f6e2f1\") " pod="opendatahub/test-curl-9517-1eb0f1" Oct 30 23:48:36.222596 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:36.222545 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9517-1eb0f1" Oct 30 23:48:36.530476 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:36.530443 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9517-1eb0f1"] Oct 30 23:48:36.534825 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:48:36.534797 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd198dc0_589d_4d42_9062_c3b267f6e2f1.slice/crio-1b00fda77067f868d35e2de970c6da7a58e6296d38b58c2d9a62992ac5311e5c WatchSource:0}: Error finding container 1b00fda77067f868d35e2de970c6da7a58e6296d38b58c2d9a62992ac5311e5c: Status 404 returned error can't find the container with id 1b00fda77067f868d35e2de970c6da7a58e6296d38b58c2d9a62992ac5311e5c Oct 30 23:48:36.556092 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:36.556068 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9517-1eb0f1" event={"ID":"bd198dc0-589d-4d42-9062-c3b267f6e2f1","Type":"ContainerStarted","Data":"1b00fda77067f868d35e2de970c6da7a58e6296d38b58c2d9a62992ac5311e5c"} Oct 30 23:48:36.556206 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:36.556155 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-9517-770b78" podUID="c7621a1d-707f-4ae7-8d7e-e34b93b47f13" containerName="test-curl-9517-770b78" containerID="cri-o://6c3e14fe41b392094b67ba85223db7bd21fed32962763197f265651aa8c466e5" gracePeriod=2 Oct 30 23:48:37.563424 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:37.563395 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9517-1eb0f1" event={"ID":"bd198dc0-589d-4d42-9062-c3b267f6e2f1","Type":"ContainerStarted","Data":"d78f91388283ae860358c36b36ee99391cbeb12b4912a8200361821b178a8d43"} Oct 30 23:48:37.599686 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:37.599642 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-9517-1eb0f1" podStartSLOduration=2.599630537 podStartE2EDuration="2.599630537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:37.599060953 +0000 UTC m=+805.862966518" watchObservedRunningTime="2026-10-30 23:48:37.599630537 +0000 UTC m=+805.863536109" Oct 30 23:48:38.512119 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:38.512077 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9517-1eb0f1"] Oct 30 23:48:38.515579 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:38.515555 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9517-1eb0f1"] Oct 30 23:48:38.754466 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:38.754442 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9517-770b78" Oct 30 23:48:38.771549 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:38.771496 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9517-670124"] Oct 30 23:48:38.771959 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:38.771945 5112 cpu_manager.go:414] "containerMap: removing container" podUID="bd198dc0-589d-4d42-9062-c3b267f6e2f1" containerName="test-curl-9517-1eb0f1" Oct 30 23:48:38.771999 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:38.771960 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd198dc0-589d-4d42-9062-c3b267f6e2f1" containerName="test-curl-9517-1eb0f1" Oct 30 23:48:38.772078 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:38.772068 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd198dc0-589d-4d42-9062-c3b267f6e2f1" containerName="test-curl-9517-1eb0f1" Oct 30 23:48:38.775129 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:38.775110 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9517-670124" Oct 30 23:48:38.788264 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:38.788243 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9517-670124"] Oct 30 23:48:38.882780 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:38.882757 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7621a1d-707f-4ae7-8d7e-e34b93b47f13-kube-api-access-5vj65\" (UniqueName: \"kubernetes.io/projected/c7621a1d-707f-4ae7-8d7e-e34b93b47f13-kube-api-access-5vj65\") pod \"c7621a1d-707f-4ae7-8d7e-e34b93b47f13\" (UID: \"c7621a1d-707f-4ae7-8d7e-e34b93b47f13\") " Oct 30 23:48:38.882928 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:38.882914 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68qcf\" (UniqueName: \"kubernetes.io/projected/6246538d-dc0a-491c-ab4a-6952fb6fb1a1-kube-api-access-68qcf\") pod \"test-curl-9517-670124\" (UID: \"6246538d-dc0a-491c-ab4a-6952fb6fb1a1\") " pod="opendatahub/test-curl-9517-670124" Oct 30 23:48:38.884768 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:38.884747 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7621a1d-707f-4ae7-8d7e-e34b93b47f13-kube-api-access-5vj65" pod "c7621a1d-707f-4ae7-8d7e-e34b93b47f13" (UID: "c7621a1d-707f-4ae7-8d7e-e34b93b47f13"). InnerVolumeSpecName "kube-api-access-5vj65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:48:38.984213 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:38.984186 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68qcf\" (UniqueName: \"kubernetes.io/projected/6246538d-dc0a-491c-ab4a-6952fb6fb1a1-kube-api-access-68qcf\") pod \"test-curl-9517-670124\" (UID: \"6246538d-dc0a-491c-ab4a-6952fb6fb1a1\") " pod="opendatahub/test-curl-9517-670124" Oct 30 23:48:38.984343 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:38.984326 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vj65\" (UniqueName: \"kubernetes.io/projected/c7621a1d-707f-4ae7-8d7e-e34b93b47f13-kube-api-access-5vj65\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:48:39.003455 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:39.003430 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68qcf\" (UniqueName: \"kubernetes.io/projected/6246538d-dc0a-491c-ab4a-6952fb6fb1a1-kube-api-access-68qcf\") pod \"test-curl-9517-670124\" (UID: \"6246538d-dc0a-491c-ab4a-6952fb6fb1a1\") " pod="opendatahub/test-curl-9517-670124" Oct 30 23:48:39.085962 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:39.085914 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9517-670124" Oct 30 23:48:39.377859 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:39.377798 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9517-670124"] Oct 30 23:48:39.384988 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:48:39.384962 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6246538d_dc0a_491c_ab4a_6952fb6fb1a1.slice/crio-363f3e31e19c3e81250df7633b3f8d305ee389650c582df4613a109683ccd2a2 WatchSource:0}: Error finding container 363f3e31e19c3e81250df7633b3f8d305ee389650c582df4613a109683ccd2a2: Status 404 returned error can't find the container with id 363f3e31e19c3e81250df7633b3f8d305ee389650c582df4613a109683ccd2a2 Oct 30 23:48:39.574751 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:39.574724 5112 generic.go:356] "Generic (PLEG): container finished" podID="c7621a1d-707f-4ae7-8d7e-e34b93b47f13" containerID="6c3e14fe41b392094b67ba85223db7bd21fed32962763197f265651aa8c466e5" exitCode=137 Oct 30 23:48:39.574850 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:39.574764 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9517-770b78" Oct 30 23:48:39.574850 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:39.574804 5112 scope.go:122] "RemoveContainer" containerID="6c3e14fe41b392094b67ba85223db7bd21fed32962763197f265651aa8c466e5" Oct 30 23:48:39.576450 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:39.576429 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9517-670124" event={"ID":"6246538d-dc0a-491c-ab4a-6952fb6fb1a1","Type":"ContainerStarted","Data":"15347a045102df71e6b4eeeb1fcf8a81f7e4a9f4e38492d04129d6b512a8a762"} Oct 30 23:48:39.576557 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:39.576466 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9517-670124" event={"ID":"6246538d-dc0a-491c-ab4a-6952fb6fb1a1","Type":"ContainerStarted","Data":"363f3e31e19c3e81250df7633b3f8d305ee389650c582df4613a109683ccd2a2"} Oct 30 23:48:39.576557 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:39.576505 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-9517-1eb0f1" podUID="bd198dc0-589d-4d42-9062-c3b267f6e2f1" containerName="test-curl-9517-1eb0f1" containerID="cri-o://d78f91388283ae860358c36b36ee99391cbeb12b4912a8200361821b178a8d43" gracePeriod=2 Oct 30 23:48:39.583606 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:39.583588 5112 scope.go:122] "RemoveContainer" containerID="6c3e14fe41b392094b67ba85223db7bd21fed32962763197f265651aa8c466e5" Oct 30 23:48:39.583878 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:48:39.583860 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c3e14fe41b392094b67ba85223db7bd21fed32962763197f265651aa8c466e5\": container with ID starting with 6c3e14fe41b392094b67ba85223db7bd21fed32962763197f265651aa8c466e5 not found: ID does not exist" containerID="6c3e14fe41b392094b67ba85223db7bd21fed32962763197f265651aa8c466e5" Oct 30 23:48:39.583935 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:39.583888 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c3e14fe41b392094b67ba85223db7bd21fed32962763197f265651aa8c466e5"} err="failed to get container status \"6c3e14fe41b392094b67ba85223db7bd21fed32962763197f265651aa8c466e5\": rpc error: code = NotFound desc = could not find container \"6c3e14fe41b392094b67ba85223db7bd21fed32962763197f265651aa8c466e5\": container with ID starting with 6c3e14fe41b392094b67ba85223db7bd21fed32962763197f265651aa8c466e5 not found: ID does not exist" Oct 30 23:48:39.591168 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:48:39.591147 5112 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9517-1eb0f1\" is forbidden: User \"system:node:ip-10-0-138-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-142.ec2.internal' and this object" podUID="bd198dc0-589d-4d42-9062-c3b267f6e2f1" pod="opendatahub/test-curl-9517-1eb0f1" Oct 30 23:48:39.626354 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:39.626317 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-9517-670124" podStartSLOduration=1.626306747 podStartE2EDuration="1.626306747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:39.625631442 +0000 UTC m=+807.889537014" watchObservedRunningTime="2026-10-30 23:48:39.626306747 +0000 UTC m=+807.890212321" Oct 30 23:48:39.638118 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:48:39.638062 5112 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9517-770b78\" is forbidden: User \"system:node:ip-10-0-138-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-142.ec2.internal' and this object" podUID="c7621a1d-707f-4ae7-8d7e-e34b93b47f13" pod="opendatahub/test-curl-9517-770b78" Oct 30 23:48:39.650612 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:48:39.650584 5112 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9517-1eb0f1\" is forbidden: User \"system:node:ip-10-0-138-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-142.ec2.internal' and this object" podUID="bd198dc0-589d-4d42-9062-c3b267f6e2f1" pod="opendatahub/test-curl-9517-1eb0f1" Oct 30 23:48:39.875281 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:39.875245 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c7621a1d-707f-4ae7-8d7e-e34b93b47f13" path="/var/lib/kubelet/pods/c7621a1d-707f-4ae7-8d7e-e34b93b47f13/volumes" Oct 30 23:48:40.499226 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:40.499193 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9517-670124"] Oct 30 23:48:40.506197 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:40.506168 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9517-670124"] Oct 30 23:48:41.589908 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:41.589871 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-9517-670124" podUID="6246538d-dc0a-491c-ab4a-6952fb6fb1a1" containerName="test-curl-9517-670124" containerID="cri-o://15347a045102df71e6b4eeeb1fcf8a81f7e4a9f4e38492d04129d6b512a8a762" gracePeriod=2 Oct 30 23:48:41.602950 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:48:41.602920 5112 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9517-670124\" is forbidden: User \"system:node:ip-10-0-138-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-142.ec2.internal' and this object" podUID="6246538d-dc0a-491c-ab4a-6952fb6fb1a1" pod="opendatahub/test-curl-9517-670124" Oct 30 23:48:41.802149 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:41.802127 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9517-1eb0f1" Oct 30 23:48:41.814798 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:48:41.814771 5112 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9517-670124\" is forbidden: User \"system:node:ip-10-0-138-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-142.ec2.internal' and this object" podUID="6246538d-dc0a-491c-ab4a-6952fb6fb1a1" pod="opendatahub/test-curl-9517-670124" Oct 30 23:48:41.888301 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:48:41.888244 5112 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9517-670124\" is forbidden: User \"system:node:ip-10-0-138-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-142.ec2.internal' and this object" podUID="6246538d-dc0a-491c-ab4a-6952fb6fb1a1" pod="opendatahub/test-curl-9517-670124" Oct 30 23:48:41.908561 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:41.908539 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd198dc0-589d-4d42-9062-c3b267f6e2f1-kube-api-access-2fhh5\" (UniqueName: \"kubernetes.io/projected/bd198dc0-589d-4d42-9062-c3b267f6e2f1-kube-api-access-2fhh5\") pod \"bd198dc0-589d-4d42-9062-c3b267f6e2f1\" (UID: \"bd198dc0-589d-4d42-9062-c3b267f6e2f1\") " Oct 30 23:48:41.910605 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:41.910583 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd198dc0-589d-4d42-9062-c3b267f6e2f1-kube-api-access-2fhh5" pod "bd198dc0-589d-4d42-9062-c3b267f6e2f1" (UID: "bd198dc0-589d-4d42-9062-c3b267f6e2f1"). InnerVolumeSpecName "kube-api-access-2fhh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:48:42.009485 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:42.009464 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fhh5\" (UniqueName: \"kubernetes.io/projected/bd198dc0-589d-4d42-9062-c3b267f6e2f1-kube-api-access-2fhh5\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:48:42.596556 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:42.596520 5112 generic.go:356] "Generic (PLEG): container finished" podID="bd198dc0-589d-4d42-9062-c3b267f6e2f1" containerID="d78f91388283ae860358c36b36ee99391cbeb12b4912a8200361821b178a8d43" exitCode=137 Oct 30 23:48:42.596943 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:42.596560 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9517-1eb0f1" Oct 30 23:48:42.596943 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:42.596619 5112 scope.go:122] "RemoveContainer" containerID="d78f91388283ae860358c36b36ee99391cbeb12b4912a8200361821b178a8d43" Oct 30 23:48:42.608337 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:42.608316 5112 scope.go:122] "RemoveContainer" containerID="d78f91388283ae860358c36b36ee99391cbeb12b4912a8200361821b178a8d43" Oct 30 23:48:42.608744 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:48:42.608722 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d78f91388283ae860358c36b36ee99391cbeb12b4912a8200361821b178a8d43\": container with ID starting with d78f91388283ae860358c36b36ee99391cbeb12b4912a8200361821b178a8d43 not found: ID does not exist" containerID="d78f91388283ae860358c36b36ee99391cbeb12b4912a8200361821b178a8d43" Oct 30 23:48:42.608849 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:42.608752 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d78f91388283ae860358c36b36ee99391cbeb12b4912a8200361821b178a8d43"} err="failed to get container status \"d78f91388283ae860358c36b36ee99391cbeb12b4912a8200361821b178a8d43\": rpc error: code = NotFound desc = could not find container \"d78f91388283ae860358c36b36ee99391cbeb12b4912a8200361821b178a8d43\": container with ID starting with d78f91388283ae860358c36b36ee99391cbeb12b4912a8200361821b178a8d43 not found: ID does not exist" Oct 30 23:48:43.778775 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:43.778752 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9517-670124" Oct 30 23:48:43.874991 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:43.874930 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bd198dc0-589d-4d42-9062-c3b267f6e2f1" path="/var/lib/kubelet/pods/bd198dc0-589d-4d42-9062-c3b267f6e2f1/volumes" Oct 30 23:48:43.927017 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:43.926974 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6246538d-dc0a-491c-ab4a-6952fb6fb1a1-kube-api-access-68qcf\" (UniqueName: \"kubernetes.io/projected/6246538d-dc0a-491c-ab4a-6952fb6fb1a1-kube-api-access-68qcf\") pod \"6246538d-dc0a-491c-ab4a-6952fb6fb1a1\" (UID: \"6246538d-dc0a-491c-ab4a-6952fb6fb1a1\") " Oct 30 23:48:43.929082 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:43.929056 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6246538d-dc0a-491c-ab4a-6952fb6fb1a1-kube-api-access-68qcf" pod "6246538d-dc0a-491c-ab4a-6952fb6fb1a1" (UID: "6246538d-dc0a-491c-ab4a-6952fb6fb1a1"). InnerVolumeSpecName "kube-api-access-68qcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:48:44.028446 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:44.028420 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68qcf\" (UniqueName: \"kubernetes.io/projected/6246538d-dc0a-491c-ab4a-6952fb6fb1a1-kube-api-access-68qcf\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:48:44.610143 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:44.610103 5112 generic.go:356] "Generic (PLEG): container finished" podID="6246538d-dc0a-491c-ab4a-6952fb6fb1a1" containerID="15347a045102df71e6b4eeeb1fcf8a81f7e4a9f4e38492d04129d6b512a8a762" exitCode=137 Oct 30 23:48:44.610143 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:44.610144 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9517-670124" Oct 30 23:48:44.610375 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:44.610196 5112 scope.go:122] "RemoveContainer" containerID="15347a045102df71e6b4eeeb1fcf8a81f7e4a9f4e38492d04129d6b512a8a762" Oct 30 23:48:44.620988 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:44.620672 5112 scope.go:122] "RemoveContainer" containerID="15347a045102df71e6b4eeeb1fcf8a81f7e4a9f4e38492d04129d6b512a8a762" Oct 30 23:48:44.621085 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:48:44.620994 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15347a045102df71e6b4eeeb1fcf8a81f7e4a9f4e38492d04129d6b512a8a762\": container with ID starting with 15347a045102df71e6b4eeeb1fcf8a81f7e4a9f4e38492d04129d6b512a8a762 not found: ID does not exist" containerID="15347a045102df71e6b4eeeb1fcf8a81f7e4a9f4e38492d04129d6b512a8a762" Oct 30 23:48:44.621085 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:44.621018 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15347a045102df71e6b4eeeb1fcf8a81f7e4a9f4e38492d04129d6b512a8a762"} err="failed to get container status \"15347a045102df71e6b4eeeb1fcf8a81f7e4a9f4e38492d04129d6b512a8a762\": rpc error: code = NotFound desc = could not find container \"15347a045102df71e6b4eeeb1fcf8a81f7e4a9f4e38492d04129d6b512a8a762\": container with ID starting with 15347a045102df71e6b4eeeb1fcf8a81f7e4a9f4e38492d04129d6b512a8a762 not found: ID does not exist" Oct 30 23:48:45.875827 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:45.875799 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6246538d-dc0a-491c-ab4a-6952fb6fb1a1" path="/var/lib/kubelet/pods/6246538d-dc0a-491c-ab4a-6952fb6fb1a1/volumes" Oct 30 23:48:47.041525 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.041496 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v"] Oct 30 23:48:47.041971 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.041958 5112 cpu_manager.go:414] "containerMap: removing container" podUID="6246538d-dc0a-491c-ab4a-6952fb6fb1a1" containerName="test-curl-9517-670124" Oct 30 23:48:47.042009 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.041973 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6246538d-dc0a-491c-ab4a-6952fb6fb1a1" containerName="test-curl-9517-670124" Oct 30 23:48:47.042120 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.042110 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="6246538d-dc0a-491c-ab4a-6952fb6fb1a1" containerName="test-curl-9517-670124" Oct 30 23:48:47.046633 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.046618 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:48:47.081618 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.081587 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-main-8d2ae1-serving-cert\"" Oct 30 23:48:47.081618 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.081592 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:48:47.081822 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.081683 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:48:47.081822 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.081720 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Oct 30 23:48:47.081962 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.081827 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-626qd\"" Oct 30 23:48:47.096781 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.096753 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v"] Oct 30 23:48:47.157636 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.157605 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4vfz\" (UniqueName: \"kubernetes.io/projected/e60fafe7-5855-44de-a2a9-835b6ed985ce-kube-api-access-k4vfz\") pod \"maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:48:47.157781 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.157642 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e60fafe7-5855-44de-a2a9-835b6ed985ce-metrics-certs\") pod \"maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:48:47.157781 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.157663 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e60fafe7-5855-44de-a2a9-835b6ed985ce-maas-api-tls\") pod \"maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:48:47.157875 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.157839 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60fafe7-5855-44de-a2a9-835b6ed985ce-openshift-service-ca\") pod \"maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:48:47.259356 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.259325 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60fafe7-5855-44de-a2a9-835b6ed985ce-openshift-service-ca\") pod \"maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:48:47.260746 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.260656 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60fafe7-5855-44de-a2a9-835b6ed985ce-openshift-service-ca\") pod \"maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:48:47.261006 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.260923 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4vfz\" (UniqueName: \"kubernetes.io/projected/e60fafe7-5855-44de-a2a9-835b6ed985ce-kube-api-access-k4vfz\") pod \"maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:48:47.261006 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.260980 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e60fafe7-5855-44de-a2a9-835b6ed985ce-metrics-certs\") pod \"maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:48:47.261207 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.261009 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e60fafe7-5855-44de-a2a9-835b6ed985ce-maas-api-tls\") pod \"maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:48:47.265410 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.265384 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e60fafe7-5855-44de-a2a9-835b6ed985ce-maas-api-tls\") pod \"maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:48:47.266145 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.266105 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e60fafe7-5855-44de-a2a9-835b6ed985ce-metrics-certs\") pod \"maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:48:47.292500 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.292435 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4vfz\" (UniqueName: \"kubernetes.io/projected/e60fafe7-5855-44de-a2a9-835b6ed985ce-kube-api-access-k4vfz\") pod \"maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:48:47.361811 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.361783 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:48:47.736351 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:47.736271 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v"] Oct 30 23:48:47.741896 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:48:47.741871 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode60fafe7_5855_44de_a2a9_835b6ed985ce.slice/crio-7ea554d26765588c74ab9e1ca7da12833f6e30831110b96e568c13669c3d4292 WatchSource:0}: Error finding container 7ea554d26765588c74ab9e1ca7da12833f6e30831110b96e568c13669c3d4292: Status 404 returned error can't find the container with id 7ea554d26765588c74ab9e1ca7da12833f6e30831110b96e568c13669c3d4292 Oct 30 23:48:48.642469 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:48.642437 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" event={"ID":"e60fafe7-5855-44de-a2a9-835b6ed985ce","Type":"ContainerStarted","Data":"7db776f0ab1ae9b5bca763d5eb51063d15d9e87f2fdd8609cb9f22773d0e9853"} Oct 30 23:48:48.642841 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:48.642485 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" event={"ID":"e60fafe7-5855-44de-a2a9-835b6ed985ce","Type":"ContainerStarted","Data":"7ea554d26765588c74ab9e1ca7da12833f6e30831110b96e568c13669c3d4292"} Oct 30 23:48:48.642841 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:48.642558 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:48:48.694794 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:48.694753 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" podStartSLOduration=1.318137837 podStartE2EDuration="1.694740451s" totalImagesPullingTime="376.602614ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:48.69138134 +0000 UTC m=+816.955286924" watchObservedRunningTime="2026-10-30 23:48:48.694740451 +0000 UTC m=+816.958646024" Oct 30 23:48:53.060102 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:48:53.060064 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:48:54.654589 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:48:54.654562 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:49:01.556936 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.556904 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl"] Oct 30 23:49:01.560945 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.560923 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.575746 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.575720 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-main-cd9099-openshift-default-dockercfg-zgs2j\"" Oct 30 23:49:01.590804 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.590779 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl"] Oct 30 23:49:01.710701 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.710665 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istiod-ca-cert\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.710908 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.710725 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-credential-socket\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.710908 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.710753 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-envoy\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.710908 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.710801 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-podinfo\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.710908 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.710855 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-token\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.710908 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.710906 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-workload-socket\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.711217 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.710951 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-workload-certs\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.711217 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.710985 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-data\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.711217 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.711095 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2gtn\" (UniqueName: \"kubernetes.io/projected/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-kube-api-access-z2gtn\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.812764 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.812654 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-token\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.812764 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.812753 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-workload-socket\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.812976 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.812824 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-workload-certs\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.812976 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.812877 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-data\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.813098 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.812993 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2gtn\" (UniqueName: \"kubernetes.io/projected/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-kube-api-access-z2gtn\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.813098 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.813062 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istiod-ca-cert\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.813204 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.813105 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-credential-socket\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.813204 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.813130 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-envoy\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.813204 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.813178 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-podinfo\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.813446 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.813425 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-workload-certs\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.814331 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.813744 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-credential-socket\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.814331 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.814152 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istiod-ca-cert\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.814505 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.814478 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-workload-socket\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.814736 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.814710 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-data\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.816407 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.816383 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-podinfo\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.817084 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.817026 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-envoy\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.837316 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.837293 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-token\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.837596 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.837577 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2gtn\" (UniqueName: \"kubernetes.io/projected/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-kube-api-access-z2gtn\") pod \"e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:01.879250 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:01.879228 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:02.226515 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:02.226488 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl"] Oct 30 23:49:02.229721 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:49:02.229696 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c67c18b_2bfc_4642_bcda_ece08a75bfd8.slice/crio-52a3b5b37ac03628aa7300add9e90f6f563e6d41c90ad12011b2dbdbbb755b88 WatchSource:0}: Error finding container 52a3b5b37ac03628aa7300add9e90f6f563e6d41c90ad12011b2dbdbbb755b88: Status 404 returned error can't find the container with id 52a3b5b37ac03628aa7300add9e90f6f563e6d41c90ad12011b2dbdbbb755b88 Oct 30 23:49:02.234205 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:02.234160 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:49:02.234456 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:02.234297 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:49:02.234456 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:02.234387 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:49:02.723127 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:02.723088 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" event={"ID":"9c67c18b-2bfc-4642-bcda-ece08a75bfd8","Type":"ContainerStarted","Data":"30d56dfd28ab853c7d64a4a5214f88976b0ed444536b9108640b59ffa720569d"} Oct 30 23:49:02.723477 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:02.723170 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" event={"ID":"9c67c18b-2bfc-4642-bcda-ece08a75bfd8","Type":"ContainerStarted","Data":"52a3b5b37ac03628aa7300add9e90f6f563e6d41c90ad12011b2dbdbbb755b88"} Oct 30 23:49:02.788992 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:02.788947 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" podStartSLOduration=1.788934109 podStartE2EDuration="1.788934109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:49:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:49:02.776613739 +0000 UTC m=+831.040519310" watchObservedRunningTime="2026-10-30 23:49:02.788934109 +0000 UTC m=+831.052839680" Oct 30 23:49:02.879345 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:02.879323 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:03.885443 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:03.885408 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:04.733676 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:04.733640 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:04.734550 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:04.734528 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:09.404647 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.404614 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh"] Oct 30 23:49:09.408742 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.408725 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:09.434574 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.434547 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-main-cd9099-serving-cert\"" Oct 30 23:49:09.437929 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.437897 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh"] Oct 30 23:49:09.487810 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.487778 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfvnc\" (UniqueName: \"kubernetes.io/projected/49106d27-3c03-4a19-8834-2f5ec3f130bc-kube-api-access-nfvnc\") pod \"maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:09.487929 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.487903 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49106d27-3c03-4a19-8834-2f5ec3f130bc-maas-api-tls\") pod \"maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:09.487975 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.487955 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49106d27-3c03-4a19-8834-2f5ec3f130bc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:09.488109 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.488096 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49106d27-3c03-4a19-8834-2f5ec3f130bc-metrics-certs\") pod \"maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:09.589270 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.589242 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49106d27-3c03-4a19-8834-2f5ec3f130bc-metrics-certs\") pod \"maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:09.589408 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.589283 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfvnc\" (UniqueName: \"kubernetes.io/projected/49106d27-3c03-4a19-8834-2f5ec3f130bc-kube-api-access-nfvnc\") pod \"maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:09.589408 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.589331 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49106d27-3c03-4a19-8834-2f5ec3f130bc-maas-api-tls\") pod \"maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:09.589408 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.589360 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49106d27-3c03-4a19-8834-2f5ec3f130bc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:09.590016 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.589994 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49106d27-3c03-4a19-8834-2f5ec3f130bc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:09.591775 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.591757 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49106d27-3c03-4a19-8834-2f5ec3f130bc-maas-api-tls\") pod \"maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:09.591854 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.591796 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49106d27-3c03-4a19-8834-2f5ec3f130bc-metrics-certs\") pod \"maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:09.608347 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.608318 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfvnc\" (UniqueName: \"kubernetes.io/projected/49106d27-3c03-4a19-8834-2f5ec3f130bc-kube-api-access-nfvnc\") pod \"maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:09.722595 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:09.722512 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:10.020874 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:10.020847 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh"] Oct 30 23:49:10.024396 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:49:10.024368 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49106d27_3c03_4a19_8834_2f5ec3f130bc.slice/crio-f935ad1aaef997afa05623162dcaf84fc4859d4946a180cd25a4e20f38b6512a WatchSource:0}: Error finding container f935ad1aaef997afa05623162dcaf84fc4859d4946a180cd25a4e20f38b6512a: Status 404 returned error can't find the container with id f935ad1aaef997afa05623162dcaf84fc4859d4946a180cd25a4e20f38b6512a Oct 30 23:49:10.774550 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:10.774511 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" event={"ID":"49106d27-3c03-4a19-8834-2f5ec3f130bc","Type":"ContainerStarted","Data":"81dde56e7580d877b3c7cf5c2deb709b9781dfdc77c3989ca512c34cc39822ac"} Oct 30 23:49:10.775020 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:10.774720 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:10.775020 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:10.774755 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" event={"ID":"49106d27-3c03-4a19-8834-2f5ec3f130bc","Type":"ContainerStarted","Data":"f935ad1aaef997afa05623162dcaf84fc4859d4946a180cd25a4e20f38b6512a"} Oct 30 23:49:10.816272 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:10.816209 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" podStartSLOduration=1.488211946 podStartE2EDuration="1.816196433s" totalImagesPullingTime="327.984487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:49:10.81416233 +0000 UTC m=+839.078067914" watchObservedRunningTime="2026-10-30 23:49:10.816196433 +0000 UTC m=+839.080102005" Oct 30 23:49:16.802346 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:16.802309 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:49:22.975579 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:49:22.975548 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:49:23.856149 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:23.856111 5112 generic.go:356] "Generic (PLEG): container finished" podID="9c67c18b-2bfc-4642-bcda-ece08a75bfd8" containerID="30d56dfd28ab853c7d64a4a5214f88976b0ed444536b9108640b59ffa720569d" exitCode=0 Oct 30 23:49:23.856316 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:23.856186 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" event={"ID":"9c67c18b-2bfc-4642-bcda-ece08a75bfd8","Type":"ContainerDied","Data":"30d56dfd28ab853c7d64a4a5214f88976b0ed444536b9108640b59ffa720569d"} Oct 30 23:49:23.856515 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:23.856501 5112 scope.go:122] "RemoveContainer" containerID="30d56dfd28ab853c7d64a4a5214f88976b0ed444536b9108640b59ffa720569d" Oct 30 23:49:23.857595 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:23.857570 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:49:23.857649 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:23.857637 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:49:23.857685 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:23.857670 5112 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 30 23:49:24.863850 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:24.863815 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" event={"ID":"9c67c18b-2bfc-4642-bcda-ece08a75bfd8","Type":"ContainerStarted","Data":"001762b16f45b4af214798a31d38ad4efc71ceec6a6b62e5c44a8805ad0f5cd4"} Oct 30 23:49:24.886486 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:24.885457 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:24.886771 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:24.886746 5112 patch_prober.go:29] interesting pod/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 30 23:49:24.886915 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:24.886894 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" podUID="9c67c18b-2bfc-4642-bcda-ece08a75bfd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 30 23:49:25.889187 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:25.889152 5112 patch_prober.go:29] interesting pod/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 30 23:49:25.889750 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:25.889721 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" podUID="9c67c18b-2bfc-4642-bcda-ece08a75bfd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 30 23:49:26.881409 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:26.881372 5112 patch_prober.go:29] interesting pod/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 30 23:49:26.881694 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:26.881667 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" podUID="9c67c18b-2bfc-4642-bcda-ece08a75bfd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 30 23:49:27.882499 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:27.882464 5112 patch_prober.go:29] interesting pod/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 30 23:49:27.884032 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:27.884001 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" podUID="9c67c18b-2bfc-4642-bcda-ece08a75bfd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 30 23:49:28.883064 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:28.882401 5112 patch_prober.go:29] interesting pod/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 30 23:49:28.883064 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:28.882475 5112 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" podUID="9c67c18b-2bfc-4642-bcda-ece08a75bfd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 30 23:49:29.927064 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:29.926999 5112 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:29.928638 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:29.927761 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:29.928797 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:49:29.928764 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:49:52.976966 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:49:52.976928 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:50:11.996992 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:50:11.996958 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/2.log" Oct 30 23:50:12.002197 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:50:12.002175 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/2.log" Oct 30 23:50:22.976098 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:50:22.976054 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:50:27.810167 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:50:27.810128 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-rrg7c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:50:27.810883 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:50:27.810852 5112 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-rrg7c" podUID="57eb85d4-61b3-424c-b0e6-5d2029938bcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:50:28.031270 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:50:28.031225 5112 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bkn8v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:50:28.031609 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:50:28.031582 5112 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bkn8v" podUID="1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:50:53.055026 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:50:53.054789 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:51:13.031839 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:13.031800 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk"] Oct 30 23:51:18.649006 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:18.648973 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw"] Oct 30 23:51:22.975723 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:51:22.975689 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:51:28.074663 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.074602 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" podUID="d800ac50-6129-44a5-993e-ad627159b180" containerName="main" containerID="cri-o://26aa4df92d181c98ef9a7f29225b5e9025076697e30b999e808b5dbff4270bb1" gracePeriod=45 Oct 30 23:51:28.335121 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.335035 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:51:28.449775 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.449750 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d800ac50-6129-44a5-993e-ad627159b180-tls-certs\" (UniqueName: \"kubernetes.io/secret/d800ac50-6129-44a5-993e-ad627159b180-tls-certs\") pod \"d800ac50-6129-44a5-993e-ad627159b180\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " Oct 30 23:51:28.449932 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.449786 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d800ac50-6129-44a5-993e-ad627159b180-kube-api-access-8nhxm\" (UniqueName: \"kubernetes.io/projected/d800ac50-6129-44a5-993e-ad627159b180-kube-api-access-8nhxm\") pod \"d800ac50-6129-44a5-993e-ad627159b180\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " Oct 30 23:51:28.449932 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.449855 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-tmp-dir\") pod \"d800ac50-6129-44a5-993e-ad627159b180\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " Oct 30 23:51:28.449932 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.449910 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-dshm\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-dshm\") pod \"d800ac50-6129-44a5-993e-ad627159b180\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " Oct 30 23:51:28.450129 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.449949 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-model-cache\") pod \"d800ac50-6129-44a5-993e-ad627159b180\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " Oct 30 23:51:28.450129 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.449982 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-home\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-home\") pod \"d800ac50-6129-44a5-993e-ad627159b180\" (UID: \"d800ac50-6129-44a5-993e-ad627159b180\") " Oct 30 23:51:28.450244 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.450224 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-tmp-dir" pod "d800ac50-6129-44a5-993e-ad627159b180" (UID: "d800ac50-6129-44a5-993e-ad627159b180"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:51:28.450302 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.450280 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-model-cache" pod "d800ac50-6129-44a5-993e-ad627159b180" (UID: "d800ac50-6129-44a5-993e-ad627159b180"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:51:28.450302 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.450291 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-home" pod "d800ac50-6129-44a5-993e-ad627159b180" (UID: "d800ac50-6129-44a5-993e-ad627159b180"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:51:28.450489 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.450471 5112 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-tmp-dir\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:51:28.450531 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.450490 5112 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-model-cache\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:51:28.450531 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.450498 5112 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-home\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:51:28.451920 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.451894 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d800ac50-6129-44a5-993e-ad627159b180-tls-certs" pod "d800ac50-6129-44a5-993e-ad627159b180" (UID: "d800ac50-6129-44a5-993e-ad627159b180"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:51:28.452103 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.452084 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-dshm" pod "d800ac50-6129-44a5-993e-ad627159b180" (UID: "d800ac50-6129-44a5-993e-ad627159b180"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:51:28.452228 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.452204 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d800ac50-6129-44a5-993e-ad627159b180-kube-api-access-8nhxm" pod "d800ac50-6129-44a5-993e-ad627159b180" (UID: "d800ac50-6129-44a5-993e-ad627159b180"). InnerVolumeSpecName "kube-api-access-8nhxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:51:28.550952 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.550926 5112 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d800ac50-6129-44a5-993e-ad627159b180-tls-certs\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:51:28.550952 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.550948 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nhxm\" (UniqueName: \"kubernetes.io/projected/d800ac50-6129-44a5-993e-ad627159b180-kube-api-access-8nhxm\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:51:28.551139 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.550959 5112 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d800ac50-6129-44a5-993e-ad627159b180-dshm\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:51:28.896909 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.896876 5112 generic.go:356] "Generic (PLEG): container finished" podID="d800ac50-6129-44a5-993e-ad627159b180" containerID="26aa4df92d181c98ef9a7f29225b5e9025076697e30b999e808b5dbff4270bb1" exitCode=0 Oct 30 23:51:28.897113 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.896923 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" Oct 30 23:51:28.897113 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.896959 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" event={"ID":"d800ac50-6129-44a5-993e-ad627159b180","Type":"ContainerDied","Data":"26aa4df92d181c98ef9a7f29225b5e9025076697e30b999e808b5dbff4270bb1"} Oct 30 23:51:28.897113 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.896999 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk" event={"ID":"d800ac50-6129-44a5-993e-ad627159b180","Type":"ContainerDied","Data":"d0bc5fef08d2c657dc6ed2d40cdfa71ec5e49b904c7e32f4cda78ef1b3ed64a4"} Oct 30 23:51:28.897113 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.897021 5112 scope.go:122] "RemoveContainer" containerID="26aa4df92d181c98ef9a7f29225b5e9025076697e30b999e808b5dbff4270bb1" Oct 30 23:51:28.906904 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.906879 5112 scope.go:122] "RemoveContainer" containerID="26aa4df92d181c98ef9a7f29225b5e9025076697e30b999e808b5dbff4270bb1" Oct 30 23:51:28.907194 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:51:28.907170 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26aa4df92d181c98ef9a7f29225b5e9025076697e30b999e808b5dbff4270bb1\": container with ID starting with 26aa4df92d181c98ef9a7f29225b5e9025076697e30b999e808b5dbff4270bb1 not found: ID does not exist" containerID="26aa4df92d181c98ef9a7f29225b5e9025076697e30b999e808b5dbff4270bb1" Oct 30 23:51:28.907266 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.907208 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26aa4df92d181c98ef9a7f29225b5e9025076697e30b999e808b5dbff4270bb1"} err="failed to get container status \"26aa4df92d181c98ef9a7f29225b5e9025076697e30b999e808b5dbff4270bb1\": rpc error: code = NotFound desc = could not find container \"26aa4df92d181c98ef9a7f29225b5e9025076697e30b999e808b5dbff4270bb1\": container with ID starting with 26aa4df92d181c98ef9a7f29225b5e9025076697e30b999e808b5dbff4270bb1 not found: ID does not exist" Oct 30 23:51:28.944909 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.944881 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk"] Oct 30 23:51:28.955829 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:28.955802 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-38e303fb-model-kserve-644b897f6b-rhxqk"] Oct 30 23:51:29.878499 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:29.878470 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d800ac50-6129-44a5-993e-ad627159b180" path="/var/lib/kubelet/pods/d800ac50-6129-44a5-993e-ad627159b180/volumes" Oct 30 23:51:33.935994 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:33.935956 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" podUID="4298b1ed-afe8-4077-9899-5cc8a00d8c73" containerName="main" containerID="cri-o://86a9419650fd1260211ceb7fdf0eb5edef21ea6c55ad1b9e1683ac653a84b1fe" gracePeriod=45 Oct 30 23:51:34.202639 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.202577 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:51:34.373760 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.373730 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4298b1ed-afe8-4077-9899-5cc8a00d8c73-kube-api-access-jqx2z\" (UniqueName: \"kubernetes.io/projected/4298b1ed-afe8-4077-9899-5cc8a00d8c73-kube-api-access-jqx2z\") pod \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " Oct 30 23:51:34.374015 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.373991 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-home\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-home\") pod \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " Oct 30 23:51:34.374194 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.374066 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4298b1ed-afe8-4077-9899-5cc8a00d8c73-tls-certs\" (UniqueName: \"kubernetes.io/secret/4298b1ed-afe8-4077-9899-5cc8a00d8c73-tls-certs\") pod \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " Oct 30 23:51:34.374194 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.374098 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-model-cache\") pod \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " Oct 30 23:51:34.374194 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.374171 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-dshm\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-dshm\") pod \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " Oct 30 23:51:34.374366 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.374243 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-tmp-dir\") pod \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\" (UID: \"4298b1ed-afe8-4077-9899-5cc8a00d8c73\") " Oct 30 23:51:34.374845 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.374796 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-home" pod "4298b1ed-afe8-4077-9899-5cc8a00d8c73" (UID: "4298b1ed-afe8-4077-9899-5cc8a00d8c73"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:51:34.375189 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.375165 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-model-cache" pod "4298b1ed-afe8-4077-9899-5cc8a00d8c73" (UID: "4298b1ed-afe8-4077-9899-5cc8a00d8c73"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:51:34.375360 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.375340 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-tmp-dir" pod "4298b1ed-afe8-4077-9899-5cc8a00d8c73" (UID: "4298b1ed-afe8-4077-9899-5cc8a00d8c73"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:51:34.376421 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.376388 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4298b1ed-afe8-4077-9899-5cc8a00d8c73-kube-api-access-jqx2z" pod "4298b1ed-afe8-4077-9899-5cc8a00d8c73" (UID: "4298b1ed-afe8-4077-9899-5cc8a00d8c73"). InnerVolumeSpecName "kube-api-access-jqx2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:51:34.376995 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.376971 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4298b1ed-afe8-4077-9899-5cc8a00d8c73-tls-certs" pod "4298b1ed-afe8-4077-9899-5cc8a00d8c73" (UID: "4298b1ed-afe8-4077-9899-5cc8a00d8c73"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:51:34.377239 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.377218 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-dshm" pod "4298b1ed-afe8-4077-9899-5cc8a00d8c73" (UID: "4298b1ed-afe8-4077-9899-5cc8a00d8c73"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:51:34.475662 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.475577 5112 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-dshm\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:51:34.475662 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.475613 5112 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-tmp-dir\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:51:34.475662 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.475631 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqx2z\" (UniqueName: \"kubernetes.io/projected/4298b1ed-afe8-4077-9899-5cc8a00d8c73-kube-api-access-jqx2z\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:51:34.475662 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.475644 5112 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-home\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:51:34.475662 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.475657 5112 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4298b1ed-afe8-4077-9899-5cc8a00d8c73-tls-certs\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:51:34.476108 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.475670 5112 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4298b1ed-afe8-4077-9899-5cc8a00d8c73-model-cache\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:51:34.974728 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.974683 5112 generic.go:356] "Generic (PLEG): container finished" podID="4298b1ed-afe8-4077-9899-5cc8a00d8c73" containerID="86a9419650fd1260211ceb7fdf0eb5edef21ea6c55ad1b9e1683ac653a84b1fe" exitCode=0 Oct 30 23:51:34.975237 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.974819 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" event={"ID":"4298b1ed-afe8-4077-9899-5cc8a00d8c73","Type":"ContainerDied","Data":"86a9419650fd1260211ceb7fdf0eb5edef21ea6c55ad1b9e1683ac653a84b1fe"} Oct 30 23:51:34.975237 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.974859 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" event={"ID":"4298b1ed-afe8-4077-9899-5cc8a00d8c73","Type":"ContainerDied","Data":"29ec779f4b76a9a71125abd495c7823c9cea34faead0e7eaa87df37387096c01"} Oct 30 23:51:34.975237 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.974882 5112 scope.go:122] "RemoveContainer" containerID="86a9419650fd1260211ceb7fdf0eb5edef21ea6c55ad1b9e1683ac653a84b1fe" Oct 30 23:51:34.975237 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.975080 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw" Oct 30 23:51:34.996255 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.996196 5112 scope.go:122] "RemoveContainer" containerID="86a9419650fd1260211ceb7fdf0eb5edef21ea6c55ad1b9e1683ac653a84b1fe" Oct 30 23:51:34.996530 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:51:34.996504 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86a9419650fd1260211ceb7fdf0eb5edef21ea6c55ad1b9e1683ac653a84b1fe\": container with ID starting with 86a9419650fd1260211ceb7fdf0eb5edef21ea6c55ad1b9e1683ac653a84b1fe not found: ID does not exist" containerID="86a9419650fd1260211ceb7fdf0eb5edef21ea6c55ad1b9e1683ac653a84b1fe" Oct 30 23:51:34.996611 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:34.996543 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86a9419650fd1260211ceb7fdf0eb5edef21ea6c55ad1b9e1683ac653a84b1fe"} err="failed to get container status \"86a9419650fd1260211ceb7fdf0eb5edef21ea6c55ad1b9e1683ac653a84b1fe\": rpc error: code = NotFound desc = could not find container \"86a9419650fd1260211ceb7fdf0eb5edef21ea6c55ad1b9e1683ac653a84b1fe\": container with ID starting with 86a9419650fd1260211ceb7fdf0eb5edef21ea6c55ad1b9e1683ac653a84b1fe not found: ID does not exist" Oct 30 23:51:35.031694 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:35.031666 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw"] Oct 30 23:51:35.041124 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:35.041102 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-38e303fb-unmatched-kserve-bc45c4dd4-wzscw"] Oct 30 23:51:35.923064 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:51:35.917863 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4298b1ed-afe8-4077-9899-5cc8a00d8c73" path="/var/lib/kubelet/pods/4298b1ed-afe8-4077-9899-5cc8a00d8c73/volumes" Oct 30 23:51:52.974937 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:51:52.974903 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:52:22.974416 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:52:22.974330 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:52:52.976890 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:52:52.976858 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:53:18.454891 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.454858 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v"] Oct 30 23:53:18.455418 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.455073 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" podUID="e60fafe7-5855-44de-a2a9-835b6ed985ce" containerName="maas-api" containerID="cri-o://7db776f0ab1ae9b5bca763d5eb51063d15d9e87f2fdd8609cb9f22773d0e9853" gracePeriod=30 Oct 30 23:53:18.731654 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.731578 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:53:18.842734 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.842699 5112 generic.go:356] "Generic (PLEG): container finished" podID="e60fafe7-5855-44de-a2a9-835b6ed985ce" containerID="7db776f0ab1ae9b5bca763d5eb51063d15d9e87f2fdd8609cb9f22773d0e9853" exitCode=0 Oct 30 23:53:18.842930 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.842756 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" Oct 30 23:53:18.842930 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.842792 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" event={"ID":"e60fafe7-5855-44de-a2a9-835b6ed985ce","Type":"ContainerDied","Data":"7db776f0ab1ae9b5bca763d5eb51063d15d9e87f2fdd8609cb9f22773d0e9853"} Oct 30 23:53:18.842930 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.842874 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v" event={"ID":"e60fafe7-5855-44de-a2a9-835b6ed985ce","Type":"ContainerDied","Data":"7ea554d26765588c74ab9e1ca7da12833f6e30831110b96e568c13669c3d4292"} Oct 30 23:53:18.842930 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.842903 5112 scope.go:122] "RemoveContainer" containerID="7db776f0ab1ae9b5bca763d5eb51063d15d9e87f2fdd8609cb9f22773d0e9853" Oct 30 23:53:18.852158 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.852135 5112 scope.go:122] "RemoveContainer" containerID="7db776f0ab1ae9b5bca763d5eb51063d15d9e87f2fdd8609cb9f22773d0e9853" Oct 30 23:53:18.852426 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:53:18.852407 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7db776f0ab1ae9b5bca763d5eb51063d15d9e87f2fdd8609cb9f22773d0e9853\": container with ID starting with 7db776f0ab1ae9b5bca763d5eb51063d15d9e87f2fdd8609cb9f22773d0e9853 not found: ID does not exist" containerID="7db776f0ab1ae9b5bca763d5eb51063d15d9e87f2fdd8609cb9f22773d0e9853" Oct 30 23:53:18.852486 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.852432 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7db776f0ab1ae9b5bca763d5eb51063d15d9e87f2fdd8609cb9f22773d0e9853"} err="failed to get container status \"7db776f0ab1ae9b5bca763d5eb51063d15d9e87f2fdd8609cb9f22773d0e9853\": rpc error: code = NotFound desc = could not find container \"7db776f0ab1ae9b5bca763d5eb51063d15d9e87f2fdd8609cb9f22773d0e9853\": container with ID starting with 7db776f0ab1ae9b5bca763d5eb51063d15d9e87f2fdd8609cb9f22773d0e9853 not found: ID does not exist" Oct 30 23:53:18.860587 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.860568 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e60fafe7-5855-44de-a2a9-835b6ed985ce-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60fafe7-5855-44de-a2a9-835b6ed985ce-openshift-service-ca\") pod \"e60fafe7-5855-44de-a2a9-835b6ed985ce\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " Oct 30 23:53:18.860672 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.860602 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e60fafe7-5855-44de-a2a9-835b6ed985ce-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e60fafe7-5855-44de-a2a9-835b6ed985ce-metrics-certs\") pod \"e60fafe7-5855-44de-a2a9-835b6ed985ce\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " Oct 30 23:53:18.860718 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.860704 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e60fafe7-5855-44de-a2a9-835b6ed985ce-kube-api-access-k4vfz\" (UniqueName: \"kubernetes.io/projected/e60fafe7-5855-44de-a2a9-835b6ed985ce-kube-api-access-k4vfz\") pod \"e60fafe7-5855-44de-a2a9-835b6ed985ce\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " Oct 30 23:53:18.860773 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.860733 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e60fafe7-5855-44de-a2a9-835b6ed985ce-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e60fafe7-5855-44de-a2a9-835b6ed985ce-maas-api-tls\") pod \"e60fafe7-5855-44de-a2a9-835b6ed985ce\" (UID: \"e60fafe7-5855-44de-a2a9-835b6ed985ce\") " Oct 30 23:53:18.860914 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.860887 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e60fafe7-5855-44de-a2a9-835b6ed985ce-openshift-service-ca" pod "e60fafe7-5855-44de-a2a9-835b6ed985ce" (UID: "e60fafe7-5855-44de-a2a9-835b6ed985ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:53:18.861098 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.861076 5112 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60fafe7-5855-44de-a2a9-835b6ed985ce-openshift-service-ca\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:18.862857 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.862833 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e60fafe7-5855-44de-a2a9-835b6ed985ce-maas-api-tls" pod "e60fafe7-5855-44de-a2a9-835b6ed985ce" (UID: "e60fafe7-5855-44de-a2a9-835b6ed985ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:53:18.863164 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.863144 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e60fafe7-5855-44de-a2a9-835b6ed985ce-metrics-certs" pod "e60fafe7-5855-44de-a2a9-835b6ed985ce" (UID: "e60fafe7-5855-44de-a2a9-835b6ed985ce"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:53:18.863247 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.863168 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e60fafe7-5855-44de-a2a9-835b6ed985ce-kube-api-access-k4vfz" pod "e60fafe7-5855-44de-a2a9-835b6ed985ce" (UID: "e60fafe7-5855-44de-a2a9-835b6ed985ce"). InnerVolumeSpecName "kube-api-access-k4vfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:53:18.962541 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.962507 5112 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e60fafe7-5855-44de-a2a9-835b6ed985ce-metrics-certs\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:18.962541 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.962536 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4vfz\" (UniqueName: \"kubernetes.io/projected/e60fafe7-5855-44de-a2a9-835b6ed985ce-kube-api-access-k4vfz\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:18.962541 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:18.962546 5112 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e60fafe7-5855-44de-a2a9-835b6ed985ce-maas-api-tls\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:19.187068 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:19.186538 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v"] Oct 30 23:53:19.192440 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:19.192416 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-8d2ae1-6c66887d78-zbw4v"] Oct 30 23:53:19.875137 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:19.875108 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e60fafe7-5855-44de-a2a9-835b6ed985ce" path="/var/lib/kubelet/pods/e60fafe7-5855-44de-a2a9-835b6ed985ce/volumes" Oct 30 23:53:22.975445 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:53:22.975412 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:53:42.054965 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.054930 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh"] Oct 30 23:53:42.055626 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.055163 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" podUID="49106d27-3c03-4a19-8834-2f5ec3f130bc" containerName="maas-api" containerID="cri-o://81dde56e7580d877b3c7cf5c2deb709b9781dfdc77c3989ca512c34cc39822ac" gracePeriod=30 Oct 30 23:53:42.332974 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.332947 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:53:42.384123 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.384096 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49106d27-3c03-4a19-8834-2f5ec3f130bc-kube-api-access-nfvnc\" (UniqueName: \"kubernetes.io/projected/49106d27-3c03-4a19-8834-2f5ec3f130bc-kube-api-access-nfvnc\") pod \"49106d27-3c03-4a19-8834-2f5ec3f130bc\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " Oct 30 23:53:42.384292 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.384172 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/49106d27-3c03-4a19-8834-2f5ec3f130bc-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49106d27-3c03-4a19-8834-2f5ec3f130bc-maas-api-tls\") pod \"49106d27-3c03-4a19-8834-2f5ec3f130bc\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " Oct 30 23:53:42.384292 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.384228 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49106d27-3c03-4a19-8834-2f5ec3f130bc-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49106d27-3c03-4a19-8834-2f5ec3f130bc-openshift-service-ca\") pod \"49106d27-3c03-4a19-8834-2f5ec3f130bc\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " Oct 30 23:53:42.384292 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.384263 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/49106d27-3c03-4a19-8834-2f5ec3f130bc-metrics-certs\" (UniqueName: \"kubernetes.io/secret/49106d27-3c03-4a19-8834-2f5ec3f130bc-metrics-certs\") pod \"49106d27-3c03-4a19-8834-2f5ec3f130bc\" (UID: \"49106d27-3c03-4a19-8834-2f5ec3f130bc\") " Oct 30 23:53:42.384629 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.384598 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49106d27-3c03-4a19-8834-2f5ec3f130bc-openshift-service-ca" pod "49106d27-3c03-4a19-8834-2f5ec3f130bc" (UID: "49106d27-3c03-4a19-8834-2f5ec3f130bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:53:42.386368 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.386346 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49106d27-3c03-4a19-8834-2f5ec3f130bc-kube-api-access-nfvnc" pod "49106d27-3c03-4a19-8834-2f5ec3f130bc" (UID: "49106d27-3c03-4a19-8834-2f5ec3f130bc"). InnerVolumeSpecName "kube-api-access-nfvnc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:53:42.386368 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.386352 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49106d27-3c03-4a19-8834-2f5ec3f130bc-metrics-certs" pod "49106d27-3c03-4a19-8834-2f5ec3f130bc" (UID: "49106d27-3c03-4a19-8834-2f5ec3f130bc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:53:42.386497 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.386393 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49106d27-3c03-4a19-8834-2f5ec3f130bc-maas-api-tls" pod "49106d27-3c03-4a19-8834-2f5ec3f130bc" (UID: "49106d27-3c03-4a19-8834-2f5ec3f130bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:53:42.485109 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.485071 5112 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49106d27-3c03-4a19-8834-2f5ec3f130bc-openshift-service-ca\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:42.485109 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.485106 5112 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49106d27-3c03-4a19-8834-2f5ec3f130bc-metrics-certs\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:42.485343 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.485140 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfvnc\" (UniqueName: \"kubernetes.io/projected/49106d27-3c03-4a19-8834-2f5ec3f130bc-kube-api-access-nfvnc\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:42.485343 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.485157 5112 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49106d27-3c03-4a19-8834-2f5ec3f130bc-maas-api-tls\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:42.975784 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.975750 5112 generic.go:356] "Generic (PLEG): container finished" podID="49106d27-3c03-4a19-8834-2f5ec3f130bc" containerID="81dde56e7580d877b3c7cf5c2deb709b9781dfdc77c3989ca512c34cc39822ac" exitCode=0 Oct 30 23:53:42.975784 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.975787 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" Oct 30 23:53:42.976052 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.975829 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" event={"ID":"49106d27-3c03-4a19-8834-2f5ec3f130bc","Type":"ContainerDied","Data":"81dde56e7580d877b3c7cf5c2deb709b9781dfdc77c3989ca512c34cc39822ac"} Oct 30 23:53:42.976052 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.975883 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh" event={"ID":"49106d27-3c03-4a19-8834-2f5ec3f130bc","Type":"ContainerDied","Data":"f935ad1aaef997afa05623162dcaf84fc4859d4946a180cd25a4e20f38b6512a"} Oct 30 23:53:42.976052 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.975913 5112 scope.go:122] "RemoveContainer" containerID="81dde56e7580d877b3c7cf5c2deb709b9781dfdc77c3989ca512c34cc39822ac" Oct 30 23:53:42.985947 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.985929 5112 scope.go:122] "RemoveContainer" containerID="81dde56e7580d877b3c7cf5c2deb709b9781dfdc77c3989ca512c34cc39822ac" Oct 30 23:53:42.986279 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:53:42.986258 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81dde56e7580d877b3c7cf5c2deb709b9781dfdc77c3989ca512c34cc39822ac\": container with ID starting with 81dde56e7580d877b3c7cf5c2deb709b9781dfdc77c3989ca512c34cc39822ac not found: ID does not exist" containerID="81dde56e7580d877b3c7cf5c2deb709b9781dfdc77c3989ca512c34cc39822ac" Oct 30 23:53:42.986331 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:42.986286 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81dde56e7580d877b3c7cf5c2deb709b9781dfdc77c3989ca512c34cc39822ac"} err="failed to get container status \"81dde56e7580d877b3c7cf5c2deb709b9781dfdc77c3989ca512c34cc39822ac\": rpc error: code = NotFound desc = could not find container \"81dde56e7580d877b3c7cf5c2deb709b9781dfdc77c3989ca512c34cc39822ac\": container with ID starting with 81dde56e7580d877b3c7cf5c2deb709b9781dfdc77c3989ca512c34cc39822ac not found: ID does not exist" Oct 30 23:53:43.023824 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:43.023799 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh"] Oct 30 23:53:43.027125 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:43.027106 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-cd9099-5f5b9475b8-x2blh"] Oct 30 23:53:43.876101 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:43.876068 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="49106d27-3c03-4a19-8834-2f5ec3f130bc" path="/var/lib/kubelet/pods/49106d27-3c03-4a19-8834-2f5ec3f130bc/volumes" Oct 30 23:53:49.361050 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:49.360999 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl"] Oct 30 23:53:49.361553 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:49.361272 5112 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" podUID="9c67c18b-2bfc-4642-bcda-ece08a75bfd8" containerName="istio-proxy" containerID="cri-o://001762b16f45b4af214798a31d38ad4efc71ceec6a6b62e5c44a8805ad0f5cd4" gracePeriod=30 Oct 30 23:53:50.316481 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:50.316452 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58c4849fbd-4mtxd_be48cd81-b2fa-41ec-83c6-8c5c3bac6c10/authorino/0.log" Oct 30 23:53:52.977073 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:53:52.976971 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:53:54.623406 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.623380 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:53:54.710795 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.710739 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-workload-certs\") pod \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " Oct 30 23:53:54.710795 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.710783 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-podinfo\") pod \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " Oct 30 23:53:54.710941 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.710842 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-envoy\") pod \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " Oct 30 23:53:54.710941 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.710873 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-token\" (UniqueName: \"kubernetes.io/projected/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-token\") pod \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " Oct 30 23:53:54.710941 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.710900 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-kube-api-access-z2gtn\" (UniqueName: \"kubernetes.io/projected/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-kube-api-access-z2gtn\") pod \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " Oct 30 23:53:54.711112 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.710936 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istiod-ca-cert\") pod \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " Oct 30 23:53:54.711112 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.710965 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-credential-socket\") pod \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " Oct 30 23:53:54.711112 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.711011 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-workload-socket\") pod \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " Oct 30 23:53:54.711112 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.711033 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-workload-certs" pod "9c67c18b-2bfc-4642-bcda-ece08a75bfd8" (UID: "9c67c18b-2bfc-4642-bcda-ece08a75bfd8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:53:54.711112 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.711103 5112 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-data\") pod \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\" (UID: \"9c67c18b-2bfc-4642-bcda-ece08a75bfd8\") " Oct 30 23:53:54.711376 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.711289 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-credential-socket" pod "9c67c18b-2bfc-4642-bcda-ece08a75bfd8" (UID: "9c67c18b-2bfc-4642-bcda-ece08a75bfd8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:53:54.711443 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.711395 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istiod-ca-cert" pod "9c67c18b-2bfc-4642-bcda-ece08a75bfd8" (UID: "9c67c18b-2bfc-4642-bcda-ece08a75bfd8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:53:54.711530 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.711495 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-data" pod "9c67c18b-2bfc-4642-bcda-ece08a75bfd8" (UID: "9c67c18b-2bfc-4642-bcda-ece08a75bfd8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:53:54.711655 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.711623 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-workload-socket" pod "9c67c18b-2bfc-4642-bcda-ece08a75bfd8" (UID: "9c67c18b-2bfc-4642-bcda-ece08a75bfd8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:53:54.711655 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.711626 5112 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-workload-certs\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:54.711793 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.711666 5112 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istiod-ca-cert\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:54.711793 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.711682 5112 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-credential-socket\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:54.711793 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.711700 5112 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-data\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:54.713135 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.713112 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-podinfo" pod "9c67c18b-2bfc-4642-bcda-ece08a75bfd8" (UID: "9c67c18b-2bfc-4642-bcda-ece08a75bfd8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 23:53:54.713242 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.713166 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-token" pod "9c67c18b-2bfc-4642-bcda-ece08a75bfd8" (UID: "9c67c18b-2bfc-4642-bcda-ece08a75bfd8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:53:54.713242 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.713212 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-envoy" pod "9c67c18b-2bfc-4642-bcda-ece08a75bfd8" (UID: "9c67c18b-2bfc-4642-bcda-ece08a75bfd8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:53:54.713345 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.713268 5112 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-kube-api-access-z2gtn" pod "9c67c18b-2bfc-4642-bcda-ece08a75bfd8" (UID: "9c67c18b-2bfc-4642-bcda-ece08a75bfd8"). InnerVolumeSpecName "kube-api-access-z2gtn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:53:54.813143 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.813110 5112 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-envoy\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:54.813143 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.813141 5112 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-token\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:54.813143 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.813151 5112 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2gtn\" (UniqueName: \"kubernetes.io/projected/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-kube-api-access-z2gtn\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:54.813311 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.813162 5112 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-workload-socket\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:54.813311 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:54.813171 5112 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c67c18b-2bfc-4642-bcda-ece08a75bfd8-istio-podinfo\") on node \"ip-10-0-138-142.ec2.internal\" DevicePath \"\"" Oct 30 23:53:55.043736 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:55.043709 5112 generic.go:356] "Generic (PLEG): container finished" podID="9c67c18b-2bfc-4642-bcda-ece08a75bfd8" containerID="001762b16f45b4af214798a31d38ad4efc71ceec6a6b62e5c44a8805ad0f5cd4" exitCode=0 Oct 30 23:53:55.043864 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:55.043762 5112 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" Oct 30 23:53:55.043864 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:55.043805 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" event={"ID":"9c67c18b-2bfc-4642-bcda-ece08a75bfd8","Type":"ContainerDied","Data":"001762b16f45b4af214798a31d38ad4efc71ceec6a6b62e5c44a8805ad0f5cd4"} Oct 30 23:53:55.044003 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:55.043875 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl" event={"ID":"9c67c18b-2bfc-4642-bcda-ece08a75bfd8","Type":"ContainerDied","Data":"52a3b5b37ac03628aa7300add9e90f6f563e6d41c90ad12011b2dbdbbb755b88"} Oct 30 23:53:55.044003 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:55.043916 5112 scope.go:122] "RemoveContainer" containerID="001762b16f45b4af214798a31d38ad4efc71ceec6a6b62e5c44a8805ad0f5cd4" Oct 30 23:53:55.054588 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:55.054569 5112 scope.go:122] "RemoveContainer" containerID="30d56dfd28ab853c7d64a4a5214f88976b0ed444536b9108640b59ffa720569d" Oct 30 23:53:55.063109 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:55.063085 5112 scope.go:122] "RemoveContainer" containerID="001762b16f45b4af214798a31d38ad4efc71ceec6a6b62e5c44a8805ad0f5cd4" Oct 30 23:53:55.063399 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:53:55.063360 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"001762b16f45b4af214798a31d38ad4efc71ceec6a6b62e5c44a8805ad0f5cd4\": container with ID starting with 001762b16f45b4af214798a31d38ad4efc71ceec6a6b62e5c44a8805ad0f5cd4 not found: ID does not exist" containerID="001762b16f45b4af214798a31d38ad4efc71ceec6a6b62e5c44a8805ad0f5cd4" Oct 30 23:53:55.063456 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:55.063406 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"001762b16f45b4af214798a31d38ad4efc71ceec6a6b62e5c44a8805ad0f5cd4"} err="failed to get container status \"001762b16f45b4af214798a31d38ad4efc71ceec6a6b62e5c44a8805ad0f5cd4\": rpc error: code = NotFound desc = could not find container \"001762b16f45b4af214798a31d38ad4efc71ceec6a6b62e5c44a8805ad0f5cd4\": container with ID starting with 001762b16f45b4af214798a31d38ad4efc71ceec6a6b62e5c44a8805ad0f5cd4 not found: ID does not exist" Oct 30 23:53:55.063456 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:55.063422 5112 scope.go:122] "RemoveContainer" containerID="30d56dfd28ab853c7d64a4a5214f88976b0ed444536b9108640b59ffa720569d" Oct 30 23:53:55.063648 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:53:55.063631 5112 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30d56dfd28ab853c7d64a4a5214f88976b0ed444536b9108640b59ffa720569d\": container with ID starting with 30d56dfd28ab853c7d64a4a5214f88976b0ed444536b9108640b59ffa720569d not found: ID does not exist" containerID="30d56dfd28ab853c7d64a4a5214f88976b0ed444536b9108640b59ffa720569d" Oct 30 23:53:55.063691 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:55.063654 5112 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d56dfd28ab853c7d64a4a5214f88976b0ed444536b9108640b59ffa720569d"} err="failed to get container status \"30d56dfd28ab853c7d64a4a5214f88976b0ed444536b9108640b59ffa720569d\": rpc error: code = NotFound desc = could not find container \"30d56dfd28ab853c7d64a4a5214f88976b0ed444536b9108640b59ffa720569d\": container with ID starting with 30d56dfd28ab853c7d64a4a5214f88976b0ed444536b9108640b59ffa720569d not found: ID does not exist" Oct 30 23:53:55.093537 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:55.093515 5112 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl"] Oct 30 23:53:55.108309 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:55.108279 5112 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-main-cd9099-openshift-default-6f9968b77c-42krl"] Oct 30 23:53:55.875863 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:53:55.875834 5112 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9c67c18b-2bfc-4642-bcda-ece08a75bfd8" path="/var/lib/kubelet/pods/9c67c18b-2bfc-4642-bcda-ece08a75bfd8/volumes" Oct 30 23:54:00.768702 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:00.768660 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6f56955584-s8vq9_d06bd7b3-e785-4d8c-bb65-c56c89b32dd4/manager/0.log" Oct 30 23:54:00.956395 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:00.956361 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-54vs2_5ea3769f-4528-4091-bd9b-5f6411392ffc/manager/0.log" Oct 30 23:54:01.681850 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:01.681824 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b77d68475-n859k_39595a37-9ed7-429f-a209-954130586e38/manager/0.log" Oct 30 23:54:01.905864 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:01.905835 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-portal-stand-in-588fd98845-cjpx4_1d68c068-813f-470a-a96c-82af39d64394/placeholder/0.log" Oct 30 23:54:02.087861 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:02.087835 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-4k5cv_8d0cf9be-513f-4f2b-8a10-892d53bf4538/server/0.log" Oct 30 23:54:02.282820 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:02.282791 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-nkcj2_30b5baa9-257c-4b8a-b460-ac78c5362e5c/manager/0.log" Oct 30 23:54:02.492132 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:02.492063 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-md89q_b16043f5-2edb-4517-9596-2c023a9f378d/proxy/0.log" Oct 30 23:54:07.404807 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:07.404779 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58c4849fbd-4mtxd_be48cd81-b2fa-41ec-83c6-8c5c3bac6c10/authorino/0.log" Oct 30 23:54:07.652095 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:07.652063 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-s6vkp_fe5c4410-bd12-4879-be81-48d0653a489d/manager/0.log" Oct 30 23:54:08.242597 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:08.242567 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-2kfdx_423009d1-3599-43f6-8427-56e32c100c47/manager/0.log" Oct 30 23:54:09.440210 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:09.440178 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9_dffa18cd-835f-49ec-b205-20d8b993a068/istio-proxy/0.log" Oct 30 23:54:10.429348 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:10.429321 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-7kbkj_a18f1570-be63-490c-bc14-dde117281dcb/istio-proxy/0.log" Oct 30 23:54:10.818931 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:10.818901 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bkn8v_1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7/istio-proxy/0.log" Oct 30 23:54:11.767319 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:11.767284 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-rrg7c_57eb85d4-61b3-424c-b0e6-5d2029938bcd/istio-proxy/0.log" Oct 30 23:54:12.169930 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:12.169898 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs_3b6f83d6-3d40-4d9f-8500-7a27b603bd77/istio-proxy/0.log" Oct 30 23:54:12.372556 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:12.372491 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-vc4ft_3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868/payload-pre-processing/0.log" Oct 30 23:54:12.769571 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:12.769540 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5577b589-v98nd_f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/router/0.log" Oct 30 23:54:13.740756 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:13.740719 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-6l2cj_81a7205c-6c4b-4635-9f6f-dc7a3bd55bdd/main/0.log" Oct 30 23:54:14.551910 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:14.551876 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b82pjtb_050a281e-181c-4ef5-b388-c0714ce5a772/main/0.log" Oct 30 23:54:14.748323 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:14.748281 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-vjgt7_0453a7e7-cd4b-4def-9685-b6f36b235a1d/main/0.log" Oct 30 23:54:15.134670 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:15.134643 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-k8s8j_da8ed147-5cc6-47c4-81d9-e4911e3d247f/main/0.log" Oct 30 23:54:22.977216 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:54:22.977101 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:54:25.223882 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.223837 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bkdtx/must-gather-dwsmb"] Oct 30 23:54:25.224349 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224333 5112 cpu_manager.go:414] "containerMap: removing container" podUID="4298b1ed-afe8-4077-9899-5cc8a00d8c73" containerName="main" Oct 30 23:54:25.224420 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224353 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4298b1ed-afe8-4077-9899-5cc8a00d8c73" containerName="main" Oct 30 23:54:25.224420 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224373 5112 cpu_manager.go:414] "containerMap: removing container" podUID="49106d27-3c03-4a19-8834-2f5ec3f130bc" containerName="maas-api" Oct 30 23:54:25.224420 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224381 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49106d27-3c03-4a19-8834-2f5ec3f130bc" containerName="maas-api" Oct 30 23:54:25.224420 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224401 5112 cpu_manager.go:414] "containerMap: removing container" podUID="d800ac50-6129-44a5-993e-ad627159b180" containerName="main" Oct 30 23:54:25.224420 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224408 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d800ac50-6129-44a5-993e-ad627159b180" containerName="main" Oct 30 23:54:25.224658 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224428 5112 cpu_manager.go:414] "containerMap: removing container" podUID="e60fafe7-5855-44de-a2a9-835b6ed985ce" containerName="maas-api" Oct 30 23:54:25.224658 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224433 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e60fafe7-5855-44de-a2a9-835b6ed985ce" containerName="maas-api" Oct 30 23:54:25.224658 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224444 5112 cpu_manager.go:414] "containerMap: removing container" podUID="9c67c18b-2bfc-4642-bcda-ece08a75bfd8" containerName="istio-proxy" Oct 30 23:54:25.224658 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224449 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9c67c18b-2bfc-4642-bcda-ece08a75bfd8" containerName="istio-proxy" Oct 30 23:54:25.224658 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224550 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="9c67c18b-2bfc-4642-bcda-ece08a75bfd8" containerName="istio-proxy" Oct 30 23:54:25.224658 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224561 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="4298b1ed-afe8-4077-9899-5cc8a00d8c73" containerName="main" Oct 30 23:54:25.224658 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224566 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="49106d27-3c03-4a19-8834-2f5ec3f130bc" containerName="maas-api" Oct 30 23:54:25.224658 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224574 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="d800ac50-6129-44a5-993e-ad627159b180" containerName="main" Oct 30 23:54:25.224658 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224581 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="e60fafe7-5855-44de-a2a9-835b6ed985ce" containerName="maas-api" Oct 30 23:54:25.225546 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224670 5112 cpu_manager.go:414] "containerMap: removing container" podUID="9c67c18b-2bfc-4642-bcda-ece08a75bfd8" containerName="istio-proxy" Oct 30 23:54:25.225546 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224678 5112 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9c67c18b-2bfc-4642-bcda-ece08a75bfd8" containerName="istio-proxy" Oct 30 23:54:25.225546 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.224783 5112 memory_manager.go:365] "RemoveStaleState removing state" podUID="9c67c18b-2bfc-4642-bcda-ece08a75bfd8" containerName="istio-proxy" Oct 30 23:54:25.228032 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.228013 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-65m7m/must-gather-t4x28"] Oct 30 23:54:25.228174 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.228118 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bkdtx/must-gather-dwsmb" Oct 30 23:54:25.232462 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.232439 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-65m7m/must-gather-t4x28" Oct 30 23:54:25.248858 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.248801 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bkdtx/must-gather-dwsmb"] Oct 30 23:54:25.251993 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.251965 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-65m7m/must-gather-t4x28"] Oct 30 23:54:25.259683 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.259659 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-65m7m\"/\"default-dockercfg-m2vhm\"" Oct 30 23:54:25.259830 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.259690 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bkdtx\"/\"kube-root-ca.crt\"" Oct 30 23:54:25.259830 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.259725 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-65m7m\"/\"openshift-service-ca.crt\"" Oct 30 23:54:25.259830 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.259725 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bkdtx\"/\"openshift-service-ca.crt\"" Oct 30 23:54:25.260001 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.259754 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-65m7m\"/\"kube-root-ca.crt\"" Oct 30 23:54:25.260001 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.259769 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bkdtx\"/\"default-dockercfg-mnlxx\"" Oct 30 23:54:25.365912 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.365887 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/32465bf4-0ab2-4391-a15e-41a327292154-must-gather-output\") pod \"must-gather-t4x28\" (UID: \"32465bf4-0ab2-4391-a15e-41a327292154\") " pod="openshift-must-gather-65m7m/must-gather-t4x28" Oct 30 23:54:25.366066 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.365943 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c0f70d9d-3a50-4f72-8d19-d66af465ca30-must-gather-output\") pod \"must-gather-dwsmb\" (UID: \"c0f70d9d-3a50-4f72-8d19-d66af465ca30\") " pod="openshift-must-gather-bkdtx/must-gather-dwsmb" Oct 30 23:54:25.366116 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.366071 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmhsm\" (UniqueName: \"kubernetes.io/projected/32465bf4-0ab2-4391-a15e-41a327292154-kube-api-access-rmhsm\") pod \"must-gather-t4x28\" (UID: \"32465bf4-0ab2-4391-a15e-41a327292154\") " pod="openshift-must-gather-65m7m/must-gather-t4x28" Oct 30 23:54:25.366152 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.366114 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x4pw\" (UniqueName: \"kubernetes.io/projected/c0f70d9d-3a50-4f72-8d19-d66af465ca30-kube-api-access-7x4pw\") pod \"must-gather-dwsmb\" (UID: \"c0f70d9d-3a50-4f72-8d19-d66af465ca30\") " pod="openshift-must-gather-bkdtx/must-gather-dwsmb" Oct 30 23:54:25.467242 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.467215 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmhsm\" (UniqueName: \"kubernetes.io/projected/32465bf4-0ab2-4391-a15e-41a327292154-kube-api-access-rmhsm\") pod \"must-gather-t4x28\" (UID: \"32465bf4-0ab2-4391-a15e-41a327292154\") " pod="openshift-must-gather-65m7m/must-gather-t4x28" Oct 30 23:54:25.467356 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.467254 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x4pw\" (UniqueName: \"kubernetes.io/projected/c0f70d9d-3a50-4f72-8d19-d66af465ca30-kube-api-access-7x4pw\") pod \"must-gather-dwsmb\" (UID: \"c0f70d9d-3a50-4f72-8d19-d66af465ca30\") " pod="openshift-must-gather-bkdtx/must-gather-dwsmb" Oct 30 23:54:25.467356 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.467303 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/32465bf4-0ab2-4391-a15e-41a327292154-must-gather-output\") pod \"must-gather-t4x28\" (UID: \"32465bf4-0ab2-4391-a15e-41a327292154\") " pod="openshift-must-gather-65m7m/must-gather-t4x28" Oct 30 23:54:25.467356 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.467348 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c0f70d9d-3a50-4f72-8d19-d66af465ca30-must-gather-output\") pod \"must-gather-dwsmb\" (UID: \"c0f70d9d-3a50-4f72-8d19-d66af465ca30\") " pod="openshift-must-gather-bkdtx/must-gather-dwsmb" Oct 30 23:54:25.467656 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.467638 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c0f70d9d-3a50-4f72-8d19-d66af465ca30-must-gather-output\") pod \"must-gather-dwsmb\" (UID: \"c0f70d9d-3a50-4f72-8d19-d66af465ca30\") " pod="openshift-must-gather-bkdtx/must-gather-dwsmb" Oct 30 23:54:25.467695 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.467640 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/32465bf4-0ab2-4391-a15e-41a327292154-must-gather-output\") pod \"must-gather-t4x28\" (UID: \"32465bf4-0ab2-4391-a15e-41a327292154\") " pod="openshift-must-gather-65m7m/must-gather-t4x28" Oct 30 23:54:25.490264 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.490211 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x4pw\" (UniqueName: \"kubernetes.io/projected/c0f70d9d-3a50-4f72-8d19-d66af465ca30-kube-api-access-7x4pw\") pod \"must-gather-dwsmb\" (UID: \"c0f70d9d-3a50-4f72-8d19-d66af465ca30\") " pod="openshift-must-gather-bkdtx/must-gather-dwsmb" Oct 30 23:54:25.490418 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.490396 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmhsm\" (UniqueName: \"kubernetes.io/projected/32465bf4-0ab2-4391-a15e-41a327292154-kube-api-access-rmhsm\") pod \"must-gather-t4x28\" (UID: \"32465bf4-0ab2-4391-a15e-41a327292154\") " pod="openshift-must-gather-65m7m/must-gather-t4x28" Oct 30 23:54:25.543702 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.543681 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bkdtx/must-gather-dwsmb" Oct 30 23:54:25.550664 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.550641 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-65m7m/must-gather-t4x28" Oct 30 23:54:25.844507 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.844392 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bkdtx/must-gather-dwsmb"] Oct 30 23:54:25.850564 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.850540 5112 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 23:54:25.856721 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:25.856697 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-65m7m/must-gather-t4x28"] Oct 30 23:54:25.860206 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:54:25.860183 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32465bf4_0ab2_4391_a15e_41a327292154.slice/crio-0a73e13352715d9173fdb27b9a6e728a40230c21b6d0e5aff618343f493692ab WatchSource:0}: Error finding container 0a73e13352715d9173fdb27b9a6e728a40230c21b6d0e5aff618343f493692ab: Status 404 returned error can't find the container with id 0a73e13352715d9173fdb27b9a6e728a40230c21b6d0e5aff618343f493692ab Oct 30 23:54:26.219833 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:26.219759 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-65m7m/must-gather-t4x28" event={"ID":"32465bf4-0ab2-4391-a15e-41a327292154","Type":"ContainerStarted","Data":"0a73e13352715d9173fdb27b9a6e728a40230c21b6d0e5aff618343f493692ab"} Oct 30 23:54:26.220878 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:26.220853 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bkdtx/must-gather-dwsmb" event={"ID":"c0f70d9d-3a50-4f72-8d19-d66af465ca30","Type":"ContainerStarted","Data":"1207f8f7cf34306b16c6d340f3ad77c4d78a9b0dd15d4a0366692e6531f83111"} Oct 30 23:54:29.798165 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:29.798089 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bqgch_4d6ef5c6-97aa-41b8-94bd-c1fe2f940f91/global-pull-secret-syncer/0.log" Oct 30 23:54:30.293029 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:30.292996 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-7z66c_00f615e4-f815-49c8-b68d-23a95bc98a10/connection-checker/0.log" Oct 30 23:54:30.410656 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:30.410615 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-m926q_72875bb8-4630-4ff6-bda6-19710347ae74/connection-checker/0.log" Oct 30 23:54:30.525529 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:30.525502 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-mbbk5_ad6a30fe-07fa-48aa-92c3-4289c1066b37/connection-checker/0.log" Oct 30 23:54:30.914118 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:30.914073 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tmkjs_580f7210-4806-4d98-95c0-a1b2613c1222/konnectivity-agent/0.log" Oct 30 23:54:31.017858 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:31.017824 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-142.ec2.internal_115f903faf6fce7f69241f9f5ad98f46/haproxy/0.log" Oct 30 23:54:32.272692 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:32.272585 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bkdtx/must-gather-dwsmb" event={"ID":"c0f70d9d-3a50-4f72-8d19-d66af465ca30","Type":"ContainerStarted","Data":"6a36b269cabc41524ad6066c55eb9e1da0cb3655a492ae54a6a2dd5c685e9134"} Oct 30 23:54:32.278259 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:32.278198 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-65m7m/must-gather-t4x28" event={"ID":"32465bf4-0ab2-4391-a15e-41a327292154","Type":"ContainerStarted","Data":"f3a278d0d98367e7114d954cd432996db7489c9001b257e53d36a853c92e9b79"} Oct 30 23:54:33.286878 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:33.286826 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bkdtx/must-gather-dwsmb" event={"ID":"c0f70d9d-3a50-4f72-8d19-d66af465ca30","Type":"ContainerStarted","Data":"895cbc4fdfec49d6a80c1195933caa5b85fc082cba98dc3b75501e9632d3e63b"} Oct 30 23:54:33.288734 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:33.288706 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-65m7m/must-gather-t4x28" event={"ID":"32465bf4-0ab2-4391-a15e-41a327292154","Type":"ContainerStarted","Data":"ea10cca0a5d3c94185bdaf1470386575ab96a2a2f5f56c754cde3025263c3be5"} Oct 30 23:54:33.324426 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:33.324382 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-bkdtx/must-gather-dwsmb" podStartSLOduration=2.098613986 podStartE2EDuration="8.324369562s" totalImagesPullingTime="6.225755576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:54:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:54:33.323678504 +0000 UTC m=+1161.587584094" watchObservedRunningTime="2026-10-30 23:54:33.324369562 +0000 UTC m=+1161.588275135" Oct 30 23:54:33.359723 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:33.359672 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-65m7m/must-gather-t4x28" podStartSLOduration=2.201443688 podStartE2EDuration="8.359658695s" totalImagesPullingTime="6.158215007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:54:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:54:33.359396926 +0000 UTC m=+1161.623302498" watchObservedRunningTime="2026-10-30 23:54:33.359658695 +0000 UTC m=+1161.623564267" Oct 30 23:54:35.011582 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:35.011546 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6f56955584-s8vq9_d06bd7b3-e785-4d8c-bb65-c56c89b32dd4/manager/0.log" Oct 30 23:54:35.071074 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:35.071021 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-54vs2_5ea3769f-4528-4091-bd9b-5f6411392ffc/manager/0.log" Oct 30 23:54:35.123932 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:35.123905 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6f56955584-s8vq9_d06bd7b3-e785-4d8c-bb65-c56c89b32dd4/manager/0.log" Oct 30 23:54:35.186483 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:35.186460 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-54vs2_5ea3769f-4528-4091-bd9b-5f6411392ffc/manager/0.log" Oct 30 23:54:35.498362 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:35.498324 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b77d68475-n859k_39595a37-9ed7-429f-a209-954130586e38/manager/0.log" Oct 30 23:54:35.529937 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:35.529917 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-portal-stand-in-588fd98845-cjpx4_1d68c068-813f-470a-a96c-82af39d64394/placeholder/0.log" Oct 30 23:54:35.567812 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:35.567788 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b77d68475-n859k_39595a37-9ed7-429f-a209-954130586e38/manager/0.log" Oct 30 23:54:35.595405 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:35.595385 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-4k5cv_8d0cf9be-513f-4f2b-8a10-892d53bf4538/server/0.log" Oct 30 23:54:35.600979 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:35.600960 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-portal-stand-in-588fd98845-cjpx4_1d68c068-813f-470a-a96c-82af39d64394/placeholder/0.log" Oct 30 23:54:35.664637 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:35.664614 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-4k5cv_8d0cf9be-513f-4f2b-8a10-892d53bf4538/server/0.log" Oct 30 23:54:35.756615 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:35.756561 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-nkcj2_30b5baa9-257c-4b8a-b460-ac78c5362e5c/manager/0.log" Oct 30 23:54:35.793090 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:35.793066 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-md89q_b16043f5-2edb-4517-9596-2c023a9f378d/proxy/0.log" Oct 30 23:54:35.847069 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:35.844235 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-nkcj2_30b5baa9-257c-4b8a-b460-ac78c5362e5c/manager/0.log" Oct 30 23:54:35.883224 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:35.883206 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-md89q_b16043f5-2edb-4517-9596-2c023a9f378d/proxy/0.log" Oct 30 23:54:36.634602 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:36.634574 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58c4849fbd-4mtxd_be48cd81-b2fa-41ec-83c6-8c5c3bac6c10/authorino/0.log" Oct 30 23:54:36.766959 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:36.766927 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-s6vkp_fe5c4410-bd12-4879-be81-48d0653a489d/manager/0.log" Oct 30 23:54:37.183720 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:37.183690 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6f56955584-s8vq9_d06bd7b3-e785-4d8c-bb65-c56c89b32dd4/manager/0.log" Oct 30 23:54:37.198162 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:37.198136 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-2kfdx_423009d1-3599-43f6-8427-56e32c100c47/manager/0.log" Oct 30 23:54:37.259096 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:37.259070 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-54vs2_5ea3769f-4528-4091-bd9b-5f6411392ffc/manager/0.log" Oct 30 23:54:37.325375 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:37.325349 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6f56955584-s8vq9_d06bd7b3-e785-4d8c-bb65-c56c89b32dd4/manager/0.log" Oct 30 23:54:37.382367 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:37.382332 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-54vs2_5ea3769f-4528-4091-bd9b-5f6411392ffc/manager/0.log" Oct 30 23:54:37.573727 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:37.573698 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b77d68475-n859k_39595a37-9ed7-429f-a209-954130586e38/manager/0.log" Oct 30 23:54:37.604403 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:37.604380 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-portal-stand-in-588fd98845-cjpx4_1d68c068-813f-470a-a96c-82af39d64394/placeholder/0.log" Oct 30 23:54:37.665603 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:37.665580 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-4k5cv_8d0cf9be-513f-4f2b-8a10-892d53bf4538/server/0.log" Oct 30 23:54:37.735611 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:37.735590 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b77d68475-n859k_39595a37-9ed7-429f-a209-954130586e38/manager/0.log" Oct 30 23:54:37.771183 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:37.771157 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-portal-stand-in-588fd98845-cjpx4_1d68c068-813f-470a-a96c-82af39d64394/placeholder/0.log" Oct 30 23:54:37.832813 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:37.832748 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-nkcj2_30b5baa9-257c-4b8a-b460-ac78c5362e5c/manager/0.log" Oct 30 23:54:37.833471 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:37.833451 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-4k5cv_8d0cf9be-513f-4f2b-8a10-892d53bf4538/server/0.log" Oct 30 23:54:37.868403 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:37.868386 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-md89q_b16043f5-2edb-4517-9596-2c023a9f378d/proxy/0.log" Oct 30 23:54:37.983572 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:37.983545 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-nkcj2_30b5baa9-257c-4b8a-b460-ac78c5362e5c/manager/0.log" Oct 30 23:54:38.017645 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:38.017620 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-md89q_b16043f5-2edb-4517-9596-2c023a9f378d/proxy/0.log" Oct 30 23:54:39.294108 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.294071 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6f56955584-s8vq9_d06bd7b3-e785-4d8c-bb65-c56c89b32dd4/manager/0.log" Oct 30 23:54:39.357527 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.357502 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-54vs2_5ea3769f-4528-4091-bd9b-5f6411392ffc/manager/0.log" Oct 30 23:54:39.376808 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.376786 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6f56955584-s8vq9_d06bd7b3-e785-4d8c-bb65-c56c89b32dd4/manager/0.log" Oct 30 23:54:39.431871 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.431847 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-54vs2_5ea3769f-4528-4091-bd9b-5f6411392ffc/manager/0.log" Oct 30 23:54:39.755748 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.755719 5112 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c"] Oct 30 23:54:39.757864 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.757840 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b77d68475-n859k_39595a37-9ed7-429f-a209-954130586e38/manager/0.log" Oct 30 23:54:39.764957 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.764934 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.780603 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.780578 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c"] Oct 30 23:54:39.804338 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.804304 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/743dbed8-6210-4e9a-a07a-2f48d783a097-lib-modules\") pod \"perf-node-gather-daemonset-pzk7c\" (UID: \"743dbed8-6210-4e9a-a07a-2f48d783a097\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.804458 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.804355 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/743dbed8-6210-4e9a-a07a-2f48d783a097-proc\") pod \"perf-node-gather-daemonset-pzk7c\" (UID: \"743dbed8-6210-4e9a-a07a-2f48d783a097\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.804529 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.804487 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/743dbed8-6210-4e9a-a07a-2f48d783a097-sys\") pod \"perf-node-gather-daemonset-pzk7c\" (UID: \"743dbed8-6210-4e9a-a07a-2f48d783a097\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.804611 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.804595 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wszs\" (UniqueName: \"kubernetes.io/projected/743dbed8-6210-4e9a-a07a-2f48d783a097-kube-api-access-5wszs\") pod \"perf-node-gather-daemonset-pzk7c\" (UID: \"743dbed8-6210-4e9a-a07a-2f48d783a097\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.804666 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.804652 5112 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/743dbed8-6210-4e9a-a07a-2f48d783a097-podres\") pod \"perf-node-gather-daemonset-pzk7c\" (UID: \"743dbed8-6210-4e9a-a07a-2f48d783a097\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.810743 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.810720 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b77d68475-n859k_39595a37-9ed7-429f-a209-954130586e38/manager/0.log" Oct 30 23:54:39.815215 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.815198 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-portal-stand-in-588fd98845-cjpx4_1d68c068-813f-470a-a96c-82af39d64394/placeholder/0.log" Oct 30 23:54:39.849265 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.849245 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-portal-stand-in-588fd98845-cjpx4_1d68c068-813f-470a-a96c-82af39d64394/placeholder/0.log" Oct 30 23:54:39.861184 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.861160 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b2jtk\"/\"kube-root-ca.crt\"" Oct 30 23:54:39.861260 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.861194 5112 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b2jtk\"/\"openshift-service-ca.crt\"" Oct 30 23:54:39.861326 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.861308 5112 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b2jtk\"/\"default-dockercfg-h295r\"" Oct 30 23:54:39.882142 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.882125 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-4k5cv_8d0cf9be-513f-4f2b-8a10-892d53bf4538/server/0.log" Oct 30 23:54:39.905309 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.905288 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/743dbed8-6210-4e9a-a07a-2f48d783a097-proc\") pod \"perf-node-gather-daemonset-pzk7c\" (UID: \"743dbed8-6210-4e9a-a07a-2f48d783a097\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.905397 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.905336 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/743dbed8-6210-4e9a-a07a-2f48d783a097-sys\") pod \"perf-node-gather-daemonset-pzk7c\" (UID: \"743dbed8-6210-4e9a-a07a-2f48d783a097\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.905397 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.905391 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wszs\" (UniqueName: \"kubernetes.io/projected/743dbed8-6210-4e9a-a07a-2f48d783a097-kube-api-access-5wszs\") pod \"perf-node-gather-daemonset-pzk7c\" (UID: \"743dbed8-6210-4e9a-a07a-2f48d783a097\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.905509 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.905400 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/743dbed8-6210-4e9a-a07a-2f48d783a097-proc\") pod \"perf-node-gather-daemonset-pzk7c\" (UID: \"743dbed8-6210-4e9a-a07a-2f48d783a097\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.905509 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.905421 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/743dbed8-6210-4e9a-a07a-2f48d783a097-podres\") pod \"perf-node-gather-daemonset-pzk7c\" (UID: \"743dbed8-6210-4e9a-a07a-2f48d783a097\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.905509 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.905446 5112 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/743dbed8-6210-4e9a-a07a-2f48d783a097-lib-modules\") pod \"perf-node-gather-daemonset-pzk7c\" (UID: \"743dbed8-6210-4e9a-a07a-2f48d783a097\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.905509 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.905485 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/743dbed8-6210-4e9a-a07a-2f48d783a097-sys\") pod \"perf-node-gather-daemonset-pzk7c\" (UID: \"743dbed8-6210-4e9a-a07a-2f48d783a097\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.905641 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.905523 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/743dbed8-6210-4e9a-a07a-2f48d783a097-lib-modules\") pod \"perf-node-gather-daemonset-pzk7c\" (UID: \"743dbed8-6210-4e9a-a07a-2f48d783a097\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.905641 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.905549 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/743dbed8-6210-4e9a-a07a-2f48d783a097-podres\") pod \"perf-node-gather-daemonset-pzk7c\" (UID: \"743dbed8-6210-4e9a-a07a-2f48d783a097\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.906509 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.906490 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-4k5cv_8d0cf9be-513f-4f2b-8a10-892d53bf4538/server/0.log" Oct 30 23:54:39.924792 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.924763 5112 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wszs\" (UniqueName: \"kubernetes.io/projected/743dbed8-6210-4e9a-a07a-2f48d783a097-kube-api-access-5wszs\") pod \"perf-node-gather-daemonset-pzk7c\" (UID: \"743dbed8-6210-4e9a-a07a-2f48d783a097\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:39.968091 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:39.968071 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-sc2z6_938e07e9-87b4-4618-87c0-b59bd13e7282/cluster-monitoring-operator/0.log" Oct 30 23:54:40.079736 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:40.079680 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-nkcj2_30b5baa9-257c-4b8a-b460-ac78c5362e5c/manager/0.log" Oct 30 23:54:40.089286 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:40.089264 5112 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:40.109300 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:40.109275 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-nkcj2_30b5baa9-257c-4b8a-b460-ac78c5362e5c/manager/0.log" Oct 30 23:54:40.135984 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:40.135962 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-md89q_b16043f5-2edb-4517-9596-2c023a9f378d/proxy/0.log" Oct 30 23:54:40.160659 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:40.160621 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-md89q_b16043f5-2edb-4517-9596-2c023a9f378d/proxy/0.log" Oct 30 23:54:40.406943 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:40.406875 5112 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c"] Oct 30 23:54:40.411672 ip-10-0-138-142 kubenswrapper[5112]: W1030 23:54:40.411643 5112 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod743dbed8_6210_4e9a_a07a_2f48d783a097.slice/crio-325c9a96746887eea5f3836d97c11219aa8cf982f703f4ae3791e71c581526a5 WatchSource:0}: Error finding container 325c9a96746887eea5f3836d97c11219aa8cf982f703f4ae3791e71c581526a5: Status 404 returned error can't find the container with id 325c9a96746887eea5f3836d97c11219aa8cf982f703f4ae3791e71c581526a5 Oct 30 23:54:41.324739 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:41.324710 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zrvd9_efededbb-ac34-495f-8965-5d7712567dbf/node-exporter/0.log" Oct 30 23:54:41.346437 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:41.346406 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" event={"ID":"743dbed8-6210-4e9a-a07a-2f48d783a097","Type":"ContainerStarted","Data":"6771343c38d7486523d34730ce321de46335765f2dc7e7589269b51d0a8097dc"} Oct 30 23:54:41.346574 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:41.346457 5112 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" event={"ID":"743dbed8-6210-4e9a-a07a-2f48d783a097","Type":"ContainerStarted","Data":"325c9a96746887eea5f3836d97c11219aa8cf982f703f4ae3791e71c581526a5"} Oct 30 23:54:41.346574 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:41.346526 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:41.386572 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:41.386450 5112 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" podStartSLOduration=2.386433773 podStartE2EDuration="2.386433773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:54:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:54:41.385845786 +0000 UTC m=+1169.649751360" watchObservedRunningTime="2026-10-30 23:54:41.386433773 +0000 UTC m=+1169.650339345" Oct 30 23:54:41.430690 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:41.430649 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zrvd9_efededbb-ac34-495f-8965-5d7712567dbf/kube-rbac-proxy/0.log" Oct 30 23:54:41.539870 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:41.539838 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zrvd9_efededbb-ac34-495f-8965-5d7712567dbf/init-textfile/0.log" Oct 30 23:54:41.802641 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:41.802612 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9_dffa18cd-835f-49ec-b205-20d8b993a068/istio-proxy/0.log" Oct 30 23:54:41.916660 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:41.916627 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9_dffa18cd-835f-49ec-b205-20d8b993a068/istio-proxy/0.log" Oct 30 23:54:42.647077 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:42.647051 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-7kbkj_a18f1570-be63-490c-bc14-dde117281dcb/istio-proxy/0.log" Oct 30 23:54:42.732899 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:42.732865 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-7kbkj_a18f1570-be63-490c-bc14-dde117281dcb/istio-proxy/0.log" Oct 30 23:54:42.788264 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:42.788232 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bkn8v_1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7/istio-proxy/0.log" Oct 30 23:54:42.870734 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:42.870705 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bkn8v_1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7/istio-proxy/0.log" Oct 30 23:54:43.127501 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:43.127473 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-rrg7c_57eb85d4-61b3-424c-b0e6-5d2029938bcd/istio-proxy/0.log" Oct 30 23:54:43.196499 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:43.196474 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-rrg7c_57eb85d4-61b3-424c-b0e6-5d2029938bcd/istio-proxy/0.log" Oct 30 23:54:43.260163 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:43.260123 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs_3b6f83d6-3d40-4d9f-8500-7a27b603bd77/istio-proxy/0.log" Oct 30 23:54:43.284773 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:43.284754 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-7kb7x_9c12b085-8616-40a6-85a2-2c2c88f59389/prometheus-operator-admission-webhook/0.log" Oct 30 23:54:43.323473 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:43.323449 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-vc4ft_3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868/payload-pre-processing/0.log" Oct 30 23:54:43.325029 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:43.325007 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs_3b6f83d6-3d40-4d9f-8500-7a27b603bd77/istio-proxy/0.log" Oct 30 23:54:43.388628 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:43.388567 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-vc4ft_3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868/payload-pre-processing/0.log" Oct 30 23:54:43.456983 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:43.456961 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5577b589-v98nd_f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/router/0.log" Oct 30 23:54:43.524925 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:43.524900 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5577b589-v98nd_f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/router/0.log" Oct 30 23:54:45.224562 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:45.224534 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58c4849fbd-4mtxd_be48cd81-b2fa-41ec-83c6-8c5c3bac6c10/authorino/0.log" Oct 30 23:54:45.271601 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:45.271571 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-s6vkp_fe5c4410-bd12-4879-be81-48d0653a489d/manager/0.log" Oct 30 23:54:45.338721 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:45.338696 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58c4849fbd-4mtxd_be48cd81-b2fa-41ec-83c6-8c5c3bac6c10/authorino/0.log" Oct 30 23:54:45.434661 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:45.434635 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-s6vkp_fe5c4410-bd12-4879-be81-48d0653a489d/manager/0.log" Oct 30 23:54:45.532842 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:45.532816 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-2kfdx_423009d1-3599-43f6-8427-56e32c100c47/manager/0.log" Oct 30 23:54:45.677177 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:45.677148 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-7mrn6_1302dd34-a67e-4861-96d8-1b98c2d2e314/networking-console-plugin/0.log" Oct 30 23:54:45.709257 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:45.709209 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-2kfdx_423009d1-3599-43f6-8427-56e32c100c47/manager/0.log" Oct 30 23:54:46.684201 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:46.684172 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/2.log" Oct 30 23:54:46.691546 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:46.691522 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-958pp_707fcc17-c66a-458e-bcb5-8b3558dbe8c4/console-operator/3.log" Oct 30 23:54:47.364227 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:47.364200 5112 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-pzk7c" Oct 30 23:54:48.833624 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:48.833586 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-cht6c_f2ba63b6-5f40-4d47-9b46-ec9f8888edce/volume-data-source-validator/0.log" Oct 30 23:54:51.300060 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:51.300014 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qpgjl_b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d/dns/0.log" Oct 30 23:54:51.405991 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:51.405961 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qpgjl_b98ba0e6-a5f4-49e9-b9d4-20a7b8273f9d/kube-rbac-proxy/0.log" Oct 30 23:54:51.961262 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:51.961225 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kh84m_fc6ae729-bb57-4d5f-9112-69dc5d0abee9/dns-node-resolver/0.log" Oct 30 23:54:52.575992 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:52.575967 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9_dffa18cd-835f-49ec-b205-20d8b993a068/istio-proxy/0.log" Oct 30 23:54:52.979665 ip-10-0-138-142 kubenswrapper[5112]: E1030 23:54:52.979564 5112 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gkvsl" containerName="extractor" Oct 30 23:54:53.022208 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:53.022180 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8474d594fc-nnvg9_a852725c-b95d-456e-9885-2cbc2a55d6b8/registry/0.log" Oct 30 23:54:53.270125 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:53.270091 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-7kbkj_a18f1570-be63-490c-bc14-dde117281dcb/istio-proxy/0.log" Oct 30 23:54:53.343584 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:53.343556 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xcbst_c9448c7a-5b0e-4ff7-808b-889a0d8b022f/node-ca/0.log" Oct 30 23:54:53.357916 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:53.357892 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-776779f744-hbztc_1e79fb16-99e5-484f-b0a9-48986830b863/manager/0.log" Oct 30 23:54:53.393291 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:53.393261 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bkn8v_1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7/istio-proxy/0.log" Oct 30 23:54:53.418783 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:53.418759 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-776779f744-hbztc_1e79fb16-99e5-484f-b0a9-48986830b863/copy-manifests/0.log" Oct 30 23:54:53.704146 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:53.704076 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-rrg7c_57eb85d4-61b3-424c-b0e6-5d2029938bcd/istio-proxy/0.log" Oct 30 23:54:53.829467 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:53.829419 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs_3b6f83d6-3d40-4d9f-8500-7a27b603bd77/istio-proxy/0.log" Oct 30 23:54:53.890207 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:53.890179 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-vc4ft_3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868/payload-pre-processing/0.log" Oct 30 23:54:54.013011 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:54.012985 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5577b589-v98nd_f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/router/0.log" Oct 30 23:54:54.645764 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:54.645738 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6f56955584-s8vq9_d06bd7b3-e785-4d8c-bb65-c56c89b32dd4/manager/0.log" Oct 30 23:54:54.703411 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:54.703381 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-54vs2_5ea3769f-4528-4091-bd9b-5f6411392ffc/manager/0.log" Oct 30 23:54:55.013846 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:55.013814 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b77d68475-n859k_39595a37-9ed7-429f-a209-954130586e38/manager/0.log" Oct 30 23:54:55.046141 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:55.046121 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-portal-stand-in-588fd98845-cjpx4_1d68c068-813f-470a-a96c-82af39d64394/placeholder/0.log" Oct 30 23:54:55.047786 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:55.047753 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9_dffa18cd-835f-49ec-b205-20d8b993a068/istio-proxy/0.log" Oct 30 23:54:55.107365 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:55.107342 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-4k5cv_8d0cf9be-513f-4f2b-8a10-892d53bf4538/server/0.log" Oct 30 23:54:55.246617 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:55.246589 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-776779f744-hbztc_1e79fb16-99e5-484f-b0a9-48986830b863/manager/0.log" Oct 30 23:54:55.255327 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:55.255299 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-nkcj2_30b5baa9-257c-4b8a-b460-ac78c5362e5c/manager/0.log" Oct 30 23:54:55.295378 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:55.295325 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-md89q_b16043f5-2edb-4517-9596-2c023a9f378d/proxy/0.log" Oct 30 23:54:55.310750 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:55.310732 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-776779f744-hbztc_1e79fb16-99e5-484f-b0a9-48986830b863/copy-manifests/0.log" Oct 30 23:54:55.774620 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:55.774588 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9_dffa18cd-835f-49ec-b205-20d8b993a068/istio-proxy/0.log" Oct 30 23:54:55.963903 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:55.963871 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-7kbkj_a18f1570-be63-490c-bc14-dde117281dcb/istio-proxy/0.log" Oct 30 23:54:56.213138 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:56.212443 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bkn8v_1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7/istio-proxy/0.log" Oct 30 23:54:56.311699 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:56.311671 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7cfc97f8f7qwtt9_dffa18cd-835f-49ec-b205-20d8b993a068/istio-proxy/0.log" Oct 30 23:54:56.486194 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:56.486116 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-7kbkj_a18f1570-be63-490c-bc14-dde117281dcb/istio-proxy/0.log" Oct 30 23:54:56.624343 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:56.624305 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6f56955584-s8vq9_d06bd7b3-e785-4d8c-bb65-c56c89b32dd4/manager/0.log" Oct 30 23:54:56.643092 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:56.643070 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bkn8v_1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7/istio-proxy/0.log" Oct 30 23:54:56.686327 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:56.686303 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-54vs2_5ea3769f-4528-4091-bd9b-5f6411392ffc/manager/0.log" Oct 30 23:54:56.862157 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:56.862133 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-rrg7c_57eb85d4-61b3-424c-b0e6-5d2029938bcd/istio-proxy/0.log" Oct 30 23:54:56.966624 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:56.966594 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-rrg7c_57eb85d4-61b3-424c-b0e6-5d2029938bcd/istio-proxy/0.log" Oct 30 23:54:57.011400 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.011377 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b77d68475-n859k_39595a37-9ed7-429f-a209-954130586e38/manager/0.log" Oct 30 23:54:57.024966 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.024943 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-7kbkj_a18f1570-be63-490c-bc14-dde117281dcb/istio-proxy/0.log" Oct 30 23:54:57.048909 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.048887 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-portal-stand-in-588fd98845-cjpx4_1d68c068-813f-470a-a96c-82af39d64394/placeholder/0.log" Oct 30 23:54:57.105559 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.105527 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs_3b6f83d6-3d40-4d9f-8500-7a27b603bd77/istio-proxy/0.log" Oct 30 23:54:57.111550 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.111532 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs_3b6f83d6-3d40-4d9f-8500-7a27b603bd77/istio-proxy/0.log" Oct 30 23:54:57.130201 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.130158 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-4k5cv_8d0cf9be-513f-4f2b-8a10-892d53bf4538/server/0.log" Oct 30 23:54:57.158989 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.158966 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bkn8v_1d006dfd-c0c8-4a9b-9f3d-6248bb5102d7/istio-proxy/0.log" Oct 30 23:54:57.183089 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.183069 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-vc4ft_3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868/payload-pre-processing/0.log" Oct 30 23:54:57.223000 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.222982 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-vc4ft_3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868/payload-pre-processing/0.log" Oct 30 23:54:57.307186 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.307153 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-nkcj2_30b5baa9-257c-4b8a-b460-ac78c5362e5c/manager/0.log" Oct 30 23:54:57.324087 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.324028 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5577b589-v98nd_f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/router/0.log" Oct 30 23:54:57.345376 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.345355 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-md89q_b16043f5-2edb-4517-9596-2c023a9f378d/proxy/0.log" Oct 30 23:54:57.449968 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.448928 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5577b589-v98nd_f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/router/0.log" Oct 30 23:54:57.485266 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.485242 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-rrg7c_57eb85d4-61b3-424c-b0e6-5d2029938bcd/istio-proxy/0.log" Oct 30 23:54:57.608595 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.608570 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-65dccbd94c-74hhs_3b6f83d6-3d40-4d9f-8500-7a27b603bd77/istio-proxy/0.log" Oct 30 23:54:57.668231 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.668195 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-vc4ft_3aa7d2a7-0c91-4dfc-83cb-e3fa96fc3868/payload-pre-processing/0.log" Oct 30 23:54:57.791506 ip-10-0-138-142 kubenswrapper[5112]: I1030 23:54:57.791484 5112 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5577b589-v98nd_f0588d5b-61b4-4ba0-8cc9-1e0db0c92bb4/router/0.log"