Oct 30 21:50:20.737456 ip-10-0-140-139 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Oct 30 21:50:20.737467 ip-10-0-140-139 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Oct 30 21:50:20.737474 ip-10-0-140-139 systemd[1]: kubelet.service: Failed with result 'resources'. Oct 30 21:50:20.737686 ip-10-0-140-139 systemd[1]: Failed to start Kubernetes Kubelet. Oct 30 21:50:30.902803 ip-10-0-140-139 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Oct 30 21:50:30.902822 ip-10-0-140-139 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d61bd31f91114cda9f26c5f479f6c94a -- Oct 30 21:52:29.788107 ip-10-0-140-139 systemd[1]: Starting Kubernetes Kubelet... Oct 30 21:52:30.177220 ip-10-0-140-139 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:52:30.177220 ip-10-0-140-139 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 21:52:30.177220 ip-10-0-140-139 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:52:30.177220 ip-10-0-140-139 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:52:30.180748 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180666 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:30.180748 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180748 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:30.180748 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180752 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180755 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180758 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180761 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180763 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180766 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180769 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180772 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180774 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180777 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180780 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180783 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180786 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180789 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180791 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180799 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180802 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180805 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180808 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:30.180838 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180810 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180813 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180815 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180818 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180821 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180824 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180827 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180829 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180832 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180834 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180838 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180841 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180844 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180847 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180850 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180853 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180868 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180871 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180873 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180876 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:30.181321 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180879 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180881 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180884 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180886 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180889 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180891 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180895 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180897 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180900 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180902 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180904 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180907 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180910 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180912 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180915 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180918 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180921 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180924 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180926 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:30.181781 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180929 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180933 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180938 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180941 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180944 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180947 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180949 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180952 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180954 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180957 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180959 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180963 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180966 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180969 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180971 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180974 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180976 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180979 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180981 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:30.182235 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180984 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180987 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180989 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180992 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180995 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.180998 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181000 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181002 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181008 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181011 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181014 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181017 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181019 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181022 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181025 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181028 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181031 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181034 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181036 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:30.182685 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181039 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181041 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181044 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181046 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181049 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181051 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181054 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.181056 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182813 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182822 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182825 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182829 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182832 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182835 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182837 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182841 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182843 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182846 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182849 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182851 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:30.183149 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182869 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182872 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182875 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182877 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182880 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182883 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182886 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182888 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182891 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182894 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182896 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182899 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182901 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182905 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182908 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182911 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182913 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182916 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182919 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:30.183740 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182921 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182924 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182926 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182930 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182934 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182938 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182942 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182945 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182948 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182951 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182954 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182957 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182959 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182962 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182965 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182967 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182970 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182972 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182975 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:30.184214 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182978 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182980 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182983 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182986 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182988 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182991 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182993 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182995 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.182999 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183002 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183004 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183007 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183009 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183012 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183014 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183017 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183019 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183022 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183024 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183027 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:30.184670 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183029 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183038 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183041 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183046 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183048 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183051 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183054 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183057 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183059 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183062 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183064 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183067 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183070 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183073 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183075 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183078 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183081 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183083 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183086 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183089 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:30.185158 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183091 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183094 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183097 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183100 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183106 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183109 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183111 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183114 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183117 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183120 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183122 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183125 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183127 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183130 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183132 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183134 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183602 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183607 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183611 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:30.185619 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183613 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183616 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183619 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183621 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183627 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183630 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183633 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183635 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183638 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183641 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183644 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183647 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183650 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183652 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183655 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183658 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183660 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183663 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183665 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183668 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:30.186070 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183671 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183673 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183676 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183678 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183681 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183684 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183687 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183689 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183692 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183694 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183697 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183700 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183704 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183709 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183712 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183716 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183720 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183722 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183725 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:30.186534 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183728 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183731 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183733 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183736 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183739 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183741 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183744 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183747 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183750 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183752 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183755 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183757 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183760 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183762 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183766 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183769 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183772 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183774 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183777 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183779 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:30.186994 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183781 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183784 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183787 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183790 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183792 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183795 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183798 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183801 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183803 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183807 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183809 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183812 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183815 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183818 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183820 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183822 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183825 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183827 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183830 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:30.187461 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183832 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183835 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183837 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183839 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183842 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183844 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183847 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183849 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183852 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183869 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183872 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183874 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183877 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183879 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183882 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183884 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183887 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183890 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183893 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183895 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:30.187927 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183898 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183901 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183903 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183906 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.183910 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.184968 2580 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.184979 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.184986 2580 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.184990 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.184995 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.184999 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185004 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185008 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185012 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185015 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185018 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185022 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185025 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185028 2580 flags.go:64] FLAG: --cgroup-root="" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185031 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185034 2580 flags.go:64] FLAG: --client-ca-file="" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185037 2580 flags.go:64] FLAG: --cloud-provider="external" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185040 2580 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185045 2580 flags.go:64] FLAG: --cluster-domain="" Oct 30 21:52:30.188395 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185048 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185051 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185054 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185058 2580 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185062 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185065 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185069 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185073 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185076 2580 flags.go:64] FLAG: --contention-profiling="false" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185080 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185083 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185086 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185089 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185094 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185097 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185100 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185103 2580 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185106 2580 flags.go:64] FLAG: --enable-server="true" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185109 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185113 2580 flags.go:64] FLAG: --event-burst="100" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185117 2580 flags.go:64] FLAG: --event-qps="50" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185120 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185123 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185126 2580 flags.go:64] FLAG: --eviction-hard="" Oct 30 21:52:30.189008 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185130 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185133 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185136 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185139 2580 flags.go:64] FLAG: --eviction-soft="" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185142 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185145 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185148 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185151 2580 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185154 2580 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185157 2580 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185160 2580 flags.go:64] FLAG: --feature-gates="" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185164 2580 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185167 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185171 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185174 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185178 2580 flags.go:64] FLAG: --healthz-port="10248" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185181 2580 flags.go:64] FLAG: --help="false" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185184 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185188 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185191 2580 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185194 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185198 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185201 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 21:52:30.189590 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185204 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185207 2580 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185210 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185213 2580 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185215 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185219 2580 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185221 2580 flags.go:64] FLAG: --kube-reserved="" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185225 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185228 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185231 2580 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185234 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185236 2580 flags.go:64] FLAG: --lock-file="" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185239 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185242 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185245 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185251 2580 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185254 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185257 2580 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185260 2580 flags.go:64] FLAG: --logging-format="text" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185263 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185266 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185269 2580 flags.go:64] FLAG: --manifest-url="" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185272 2580 flags.go:64] FLAG: --manifest-url-header="" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185276 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185280 2580 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 21:52:30.190141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185284 2580 flags.go:64] FLAG: --max-pods="110" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185289 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185292 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185295 2580 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185301 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185304 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185307 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185310 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185317 2580 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185321 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185324 2580 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185327 2580 flags.go:64] FLAG: --pod-cidr="" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185330 2580 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185333 2580 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185337 2580 flags.go:64] FLAG: --pods-per-core="0" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185340 2580 flags.go:64] FLAG: --port="10250" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185342 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185345 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-02a40299008fae476" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185348 2580 flags.go:64] FLAG: --qos-reserved="" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185352 2580 flags.go:64] FLAG: --read-only-port="10255" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185355 2580 flags.go:64] FLAG: --register-node="true" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185358 2580 flags.go:64] FLAG: --register-with-taints="" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185362 2580 flags.go:64] FLAG: --registry-burst="10" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185365 2580 flags.go:64] FLAG: --registry-qps="5" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185368 2580 flags.go:64] FLAG: --reserved-cpus="" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185371 2580 flags.go:64] FLAG: --reserved-memory="" Oct 30 21:52:30.190718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185375 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185378 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185381 2580 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185384 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185387 2580 flags.go:64] FLAG: --runonce="false" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185390 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185393 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185398 2580 flags.go:64] FLAG: --seccomp-default="false" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185401 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185404 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185409 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185412 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185416 2580 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185418 2580 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185421 2580 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185424 2580 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185427 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185430 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185433 2580 flags.go:64] FLAG: --system-cgroups="" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185436 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185441 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185444 2580 flags.go:64] FLAG: --tls-cert-file="" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185447 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185452 2580 flags.go:64] FLAG: --tls-min-version="" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185454 2580 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 21:52:30.191344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185457 2580 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185460 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185463 2580 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185466 2580 flags.go:64] FLAG: --v="2" Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185470 2580 flags.go:64] FLAG: --version="false" Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185474 2580 flags.go:64] FLAG: --vmodule="" Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185478 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.185482 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185621 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185625 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185628 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185631 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185633 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185636 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185640 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185643 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185646 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185649 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185652 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185655 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185657 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:30.192071 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185660 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185663 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185666 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185668 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185671 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185674 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185677 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185679 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185682 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185684 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185687 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185690 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185692 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185695 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185697 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185700 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185703 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185705 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185708 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:30.192585 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185710 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185713 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185716 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185718 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185721 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185723 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185727 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185730 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185733 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185737 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185739 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185742 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185745 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185747 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185750 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185752 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185755 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185758 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185760 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:30.193048 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185764 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185767 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185770 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185773 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185776 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185779 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185781 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185785 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185787 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185790 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185792 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185795 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185797 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185800 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185802 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185805 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185807 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185810 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185813 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185816 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:30.193501 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185819 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185821 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185825 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185828 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185831 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185833 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185836 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185838 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185841 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185843 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185846 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185848 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185851 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185853 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185873 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185877 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185881 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185885 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185888 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:30.193986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185890 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185894 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185896 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185901 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185904 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185907 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185910 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185913 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185915 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185918 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185921 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185923 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185928 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185933 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185937 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.185963 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:30.194424 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.186026 2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186081 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186087 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186090 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186093 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186097 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186100 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186103 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186107 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186110 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186112 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186115 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186118 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186121 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186124 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186126 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186129 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186131 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186134 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186137 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:30.194803 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186139 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186142 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186145 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186148 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186151 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186153 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186156 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186159 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186162 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186165 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186168 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186170 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186173 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186176 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186179 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186181 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186184 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186187 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186190 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186192 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:30.195359 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186195 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186198 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186201 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186204 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186207 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186209 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186212 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186214 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186217 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186219 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186222 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186225 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186228 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186231 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186233 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186236 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186239 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186241 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186244 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:30.195819 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186248 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186251 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186255 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186258 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186261 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186264 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186270 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186273 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186275 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186278 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186281 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186284 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186286 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186292 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186295 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186297 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186300 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186302 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186306 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186309 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:30.196289 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186311 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186314 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186317 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186319 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186322 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186324 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186327 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186330 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186332 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186335 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186337 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186340 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186342 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186345 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186347 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186351 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186353 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186356 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186359 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:30.196760 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186362 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186366 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186369 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186374 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186378 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186381 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186386 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186388 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.186391 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.193977 2580 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.193992 2580 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.194009 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.194014 2580 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194089 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194094 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194097 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194100 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194103 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194106 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:30.197215 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194108 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194113 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194117 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194120 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194123 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194125 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194128 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194131 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194133 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194142 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194145 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194147 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194150 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194153 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194156 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194158 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194161 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194164 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194167 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194170 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:30.197692 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194173 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194176 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194179 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194181 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194184 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194186 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194189 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194192 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194194 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194197 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194199 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194202 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194205 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194208 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194211 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194213 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194216 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194219 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194221 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:30.198186 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194224 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194226 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194229 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194238 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194241 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194244 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194246 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194249 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194251 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194254 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194256 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194259 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194262 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194264 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194267 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194270 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194272 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194275 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194278 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:30.198636 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194280 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194283 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194285 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194288 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194290 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194293 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194296 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194298 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194301 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194303 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194306 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194308 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194311 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194315 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194319 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194322 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194325 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194333 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194336 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:30.199095 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194338 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194341 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194343 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194346 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194348 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194351 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194353 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194356 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194359 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194361 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194364 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194366 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194369 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194371 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194374 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194376 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194379 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194381 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194384 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194387 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:30.199529 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194390 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:30.200012 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194392 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:30.200012 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194395 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:30.200012 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.194422 2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:52:30.200012 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194616 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:30.200012 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194621 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:30.200012 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194624 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:30.200012 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194626 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:30.200012 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194629 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:30.200012 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194632 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:30.200012 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194635 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:30.200012 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194643 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:30.200012 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194646 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:30.200012 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194648 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:30.200012 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194651 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:30.200012 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194653 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194656 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194659 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194661 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194664 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194666 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194669 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194672 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194674 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194677 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194679 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194682 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194684 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194687 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194690 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194692 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194695 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194697 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194700 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194703 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:30.200361 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194705 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194708 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194710 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194712 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194715 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194717 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194720 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194722 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194725 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194733 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194736 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194738 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194741 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194744 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194746 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194749 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194751 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194754 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194756 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194764 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:30.200986 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194767 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194770 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194773 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194777 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194780 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194783 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194785 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194788 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194791 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194793 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194795 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194798 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194800 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194803 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194805 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194808 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194811 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194813 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194816 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194818 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:30.201469 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194821 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194824 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194832 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194834 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194837 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194840 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194842 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194845 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194848 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194850 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194853 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194867 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194870 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194873 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194875 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194878 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194880 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194883 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194886 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:30.201949 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194888 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:30.202396 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194891 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:30.202396 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194893 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:30.202396 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194896 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:30.202396 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194898 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:30.202396 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194901 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:30.202396 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194903 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:30.202396 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194905 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:30.202396 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194908 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:30.202396 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194910 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:30.202396 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194913 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:30.202396 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194915 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:30.202396 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194919 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:30.202396 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194922 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:30.202396 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194925 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:30.202396 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.194928 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.194957 2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195012 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195021 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195024 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195027 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195029 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195032 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195035 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195037 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195040 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195043 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195047 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195051 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195054 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195057 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:30.202736 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195060 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195062 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195065 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195068 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195070 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195072 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195075 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195077 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195080 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195082 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195085 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195087 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195090 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195093 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195096 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195098 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195101 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195103 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195112 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195116 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:30.203257 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195118 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195121 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195124 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195126 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195129 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195132 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195134 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195137 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195139 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195142 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195145 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195147 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195150 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195152 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195156 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195158 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195161 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195163 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195166 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:30.204027 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195169 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195171 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195174 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195176 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195179 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195181 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195185 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195188 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195191 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195194 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195196 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195199 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195208 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195211 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195214 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195216 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195219 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195222 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195224 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:30.204746 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195227 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195230 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195233 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195235 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195238 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195240 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195243 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195245 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195248 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195250 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195253 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195255 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195258 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195260 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195263 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195266 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195268 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195270 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195273 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:30.205296 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195276 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195278 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195280 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195283 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195286 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195288 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195292 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195300 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195303 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195306 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195308 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195311 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195315 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195318 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:30.195321 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.195370 2580 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.197945 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.199024 2580 server.go:1014] "Starting client certificate rotation" Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.199116 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 21:52:30.206061 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.199156 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 21:52:30.206510 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.201438 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 21:52:30.206738 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.206719 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 21:52:30.218102 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.218085 2580 log.go:25] "Validated CRI v1 runtime API" Oct 30 21:52:30.223532 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.223516 2580 log.go:25] "Validated CRI v1 image API" Oct 30 21:52:30.224425 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.224397 2580 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 21:52:30.229157 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.229133 2580 fs.go:135] Filesystem UUIDs: map[618ee822-2135-4fc3-b713-192526808c00:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ca09a766-1c6f-481b-a027-6c94c1b6df43:/dev/nvme0n1p4] Oct 30 21:52:30.229221 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.229156 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 30 21:52:30.234546 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.234420 2580 manager.go:217] Machine: {Timestamp:2026-10-30 21:52:30.232910538 +0000 UTC m=+0.340276281 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100610 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23fc9c1f8b0f17a852ef6cf4db2327 SystemUUID:ec23fc9c-1f8b-0f17-a852-ef6cf4db2327 BootID:d61bd31f-9111-4cda-9f26-c5f479f6c94a Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d9:77:07:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d9:77:07:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:5d:5e:ed:61:96 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 21:52:30.234546 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.234539 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 21:52:30.234657 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.234626 2580 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 21:52:30.237369 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.237343 2580 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 21:52:30.237539 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.237370 2580 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-139.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 21:52:30.237628 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.237545 2580 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 21:52:30.237628 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.237558 2580 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 21:52:30.237628 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.237606 2580 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 21:52:30.237728 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.237631 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 21:52:30.237728 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.237639 2580 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 21:52:30.238968 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.238955 2580 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 21:52:30.243394 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.243379 2580 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 21:52:30.243524 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.243513 2580 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 21:52:30.243577 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.243556 2580 kubelet.go:493] "Attempting to sync node with API server" Oct 30 21:52:30.243577 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.243570 2580 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 21:52:30.243668 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.243585 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 21:52:30.243668 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.243599 2580 kubelet.go:405] "Adding apiserver pod source" Oct 30 21:52:30.243668 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.243611 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 21:52:30.244011 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.243992 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 21:52:30.246479 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.246459 2580 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 21:52:30.256440 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.256421 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 21:52:30.257412 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.257399 2580 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 21:52:30.257451 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.257431 2580 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 21:52:30.257588 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.257578 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 21:52:30.257623 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.257600 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 21:52:30.257623 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.257611 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 21:52:30.257623 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.257619 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 21:52:30.257694 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.257634 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 21:52:30.257694 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.257649 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 21:52:30.258445 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.258432 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 21:52:30.258445 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.258442 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 21:52:30.258534 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.258451 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 21:52:30.258534 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.258458 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 21:52:30.258534 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.258467 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 21:52:30.258534 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.258477 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 21:52:30.259180 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.259170 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 21:52:30.259180 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.259180 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 21:52:30.263531 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.263516 2580 server.go:1263] "Started kubelet" Oct 30 21:52:30.263621 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.263590 2580 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 21:52:30.263687 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.263612 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 21:52:30.263729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.263716 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 21:52:30.264356 ip-10-0-140-139 systemd[1]: Started Kubernetes Kubelet. Oct 30 21:52:30.265062 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.265043 2580 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 21:52:30.266272 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.266260 2580 server.go:317] "Adding debug handlers to kubelet server" Oct 30 21:52:30.269806 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.269790 2580 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 30 21:52:30.272278 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.272259 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 21:52:30.273581 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.273567 2580 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 21:52:30.273690 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.273668 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:30.274314 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.274297 2580 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 21:52:30.274314 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.274307 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 21:52:30.274456 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.274327 2580 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 21:52:30.274513 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.274478 2580 reconstruct.go:97] "Volume reconstruction finished" Oct 30 21:52:30.274513 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.274486 2580 reconciler.go:29] "Reconciler: start to sync state" Oct 30 21:52:30.274629 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.274613 2580 factory.go:55] Registering systemd factory Oct 30 21:52:30.274674 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.274633 2580 factory.go:223] Registration of the systemd container factory successfully Oct 30 21:52:30.274884 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.274871 2580 factory.go:153] Registering CRI-O factory Oct 30 21:52:30.274934 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.274887 2580 factory.go:223] Registration of the crio container factory successfully Oct 30 21:52:30.274973 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.274963 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 21:52:30.275015 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.274980 2580 factory.go:103] Registering Raw factory Oct 30 21:52:30.275015 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.275000 2580 manager.go:1199] Started watching for new ooms in manager Oct 30 21:52:30.275786 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.275765 2580 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 30 21:52:30.275868 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.275838 2580 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-139.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 30 21:52:30.275923 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.275907 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-139.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 30 21:52:30.276009 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.275990 2580 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-139.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 30 21:52:30.276274 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.276260 2580 manager.go:319] Starting recovery of all containers Oct 30 21:52:30.276884 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.275693 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-139.us-east-2.compute.internal.18e36d34d2a72b6a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-139.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-139.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 21:52:30.263487338 +0000 UTC m=+0.370853080,LastTimestamp:2026-10-30 21:52:30.263487338 +0000 UTC m=+0.370853080,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-139.us-east-2.compute.internal,}" Oct 30 21:52:30.287726 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.287703 2580 manager.go:324] Recovery completed Oct 30 21:52:30.287992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.287969 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zgfkn" Oct 30 21:52:30.292306 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.292293 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:52:30.294655 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.294638 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:52:30.294716 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.294673 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:52:30.294716 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.294689 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:52:30.295161 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.295138 2580 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 30 21:52:30.295355 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.295338 2580 cpu_manager.go:226] "Starting" policy="none" Oct 30 21:52:30.295355 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.295352 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:52:30.295487 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.295353 2580 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 21:52:30.295487 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.295429 2580 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 21:52:30.296523 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.296483 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:52:30.296523 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.296517 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:52:30.296652 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.296538 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:52:30.297687 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.297675 2580 policy_none.go:50] "Start" Oct 30 21:52:30.297748 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.297692 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 21:52:30.297748 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.297705 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 21:52:30.299825 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.299814 2580 policy_none.go:44] "Start" Oct 30 21:52:30.304004 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.303984 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zgfkn" Oct 30 21:52:30.306565 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.306486 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-139.us-east-2.compute.internal.18e36d34d482c23a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-139.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-139.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-139.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 21:52:30.294655546 +0000 UTC m=+0.402021291,LastTimestamp:2026-10-30 21:52:30.294655546 +0000 UTC m=+0.402021291,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-139.us-east-2.compute.internal,}" Oct 30 21:52:30.311279 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.311210 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-139.us-east-2.compute.internal.18e36d34d48322e8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-139.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-139.us-east-2.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-139.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 21:52:30.294680296 +0000 UTC m=+0.402046041,LastTimestamp:2026-10-30 21:52:30.294680296 +0000 UTC m=+0.402046041,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-139.us-east-2.compute.internal,}" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.336411 2580 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.338936 2580 manager.go:341] "Starting Device Plugin manager" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.338959 2580 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.338967 2580 server.go:87] "Starting device plugin registration server" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.339218 2580 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.339227 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.339331 2580 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.339421 2580 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.339430 2580 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.340596 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.340939 2580 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.340985 2580 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.342144 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.342165 2580 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.342208 2580 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.342249 2580 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 30 21:52:30.350354 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.347501 2580 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:52:30.439996 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.439935 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:52:30.440830 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.440816 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:52:30.440909 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.440843 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:52:30.440909 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.440854 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:52:30.440909 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.440889 2580 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.442922 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.442899 2580 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal"] Oct 30 21:52:30.442973 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.442962 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:52:30.443683 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.443665 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:52:30.443770 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.443698 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:52:30.443770 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.443709 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:52:30.445912 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.445901 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:52:30.446106 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.446090 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.446176 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.446128 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:52:30.446689 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.446671 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:52:30.446768 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.446702 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:52:30.446768 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.446712 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:52:30.446768 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.446722 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:52:30.446768 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.446735 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:52:30.446768 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.446744 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:52:30.448817 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.448803 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.448908 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.448832 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:52:30.449654 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.449641 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:52:30.449698 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.449667 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:52:30.449698 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.449677 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:52:30.451326 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.451311 2580 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.451400 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.451340 2580 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-139.us-east-2.compute.internal\": node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:30.484305 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.484284 2580 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" node="ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.486840 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.486823 2580 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" node="ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.499073 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.499057 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:30.575815 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.575787 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c692c4e8d6c927c981b5bf36ba589e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"4c692c4e8d6c927c981b5bf36ba589e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.575945 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.575818 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c692c4e8d6c927c981b5bf36ba589e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"4c692c4e8d6c927c981b5bf36ba589e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.575945 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.575894 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b10322e84c5fc9db7c569a5553b27b9d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"b10322e84c5fc9db7c569a5553b27b9d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.600053 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.600032 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:30.676436 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.676413 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c692c4e8d6c927c981b5bf36ba589e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"4c692c4e8d6c927c981b5bf36ba589e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.676512 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.676458 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c692c4e8d6c927c981b5bf36ba589e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"4c692c4e8d6c927c981b5bf36ba589e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.676512 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.676478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b10322e84c5fc9db7c569a5553b27b9d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"b10322e84c5fc9db7c569a5553b27b9d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.676575 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.676511 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b10322e84c5fc9db7c569a5553b27b9d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"b10322e84c5fc9db7c569a5553b27b9d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.676575 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.676505 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c692c4e8d6c927c981b5bf36ba589e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"4c692c4e8d6c927c981b5bf36ba589e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.676575 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.676517 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c692c4e8d6c927c981b5bf36ba589e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"4c692c4e8d6c927c981b5bf36ba589e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.700555 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.700509 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:30.789280 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.789246 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.792421 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:30.792406 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:30.801446 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.801306 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:30.901783 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:30.901754 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:31.002307 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:31.002272 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:31.102665 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:31.102647 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:31.199025 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.199007 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 30 21:52:31.199397 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.199145 2580 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 21:52:31.203167 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:31.203151 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:31.303457 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:31.303436 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:31.307087 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.307071 2580 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:52:31.309490 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.309432 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:47:30 +0000 UTC" deadline="2028-05-21 18:25:26.770141022 +0000 UTC" Oct 30 21:52:31.309490 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.309488 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13652h32m55.460655491s" Oct 30 21:52:31.328710 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.328693 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:52:31.329821 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.329806 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:52:31.329947 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.329838 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:52:31.329947 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.329870 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:52:31.404181 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:31.404167 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:31.412560 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:31.412533 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10322e84c5fc9db7c569a5553b27b9d.slice/crio-b61a0e2e382177458b759f1f9b6113c77e16287ead5e9551e7e52381aa5f9096 WatchSource:0}: Error finding container b61a0e2e382177458b759f1f9b6113c77e16287ead5e9551e7e52381aa5f9096: Status 404 returned error can't find the container with id b61a0e2e382177458b759f1f9b6113c77e16287ead5e9551e7e52381aa5f9096 Oct 30 21:52:31.412942 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:31.412924 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c692c4e8d6c927c981b5bf36ba589e2.slice/crio-cb7dda04a39fa37758507df57f0dc9002834e781ef8e334502efac6fe71b00ad WatchSource:0}: Error finding container cb7dda04a39fa37758507df57f0dc9002834e781ef8e334502efac6fe71b00ad: Status 404 returned error can't find the container with id cb7dda04a39fa37758507df57f0dc9002834e781ef8e334502efac6fe71b00ad Oct 30 21:52:31.418386 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.418368 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 21:52:31.504579 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:31.504558 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:31.604964 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:31.604908 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:31.632547 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.632529 2580 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:52:31.705894 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:31.705873 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:52:31.731624 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.731606 2580 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:52:31.774736 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.774719 2580 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:31.789981 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.789963 2580 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:52:31.791062 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.791051 2580 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:52:31.799324 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:31.799311 2580 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:52:32.244423 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.244388 2580 apiserver.go:52] "Watching apiserver" Oct 30 21:52:32.252692 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.252671 2580 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 21:52:32.253078 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.253036 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal","openshift-multus/multus-7s4gp","openshift-multus/network-metrics-daemon-ztlk7","kube-system/global-pull-secret-syncer-s5jhm","openshift-cluster-node-tuning-operator/tuned-hchhj","openshift-multus/multus-additional-cni-plugins-vpw8h","openshift-network-diagnostics/network-check-target-dxkrb","openshift-network-operator/iptables-alerter-npvbd","openshift-ovn-kubernetes/ovnkube-node-d75zh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww","openshift-dns/node-resolver-4d225","kube-system/konnectivity-agent-25wb5","kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal","openshift-image-registry/node-ca-dgfl4"] Oct 30 21:52:32.255337 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.255286 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:32.255420 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.255365 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxkrb" podUID="c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b" Oct 30 21:52:32.257242 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.257225 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4d225" Oct 30 21:52:32.259266 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.259248 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:32.259343 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.259325 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ztlk7" podUID="b6b30cd9-d376-4e9e-8f95-d4d2c504cd93" Oct 30 21:52:32.261474 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.261457 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:32.261558 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.261508 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5jhm" podUID="967b7974-ef9d-4eff-8265-879c05e6fc96" Oct 30 21:52:32.264989 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.264969 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.265088 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.265069 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 21:52:32.265142 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.265069 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 21:52:32.265142 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.265110 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q26ql\"" Oct 30 21:52:32.265428 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.265415 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.267517 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.267501 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.269752 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.269736 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:52:32.271604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.271587 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.273712 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.273693 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 30 21:52:32.274000 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.273984 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.277749 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.276089 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:52:32.278509 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.278489 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:52:32.283889 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.283869 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-multus-certs\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.284022 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.283999 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/967b7974-ef9d-4eff-8265-879c05e6fc96-kubelet-config\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:32.284095 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-etc-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.284095 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284063 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-kubernetes\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.284189 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284102 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.284189 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284161 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-tmp-dir\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:52:32.284281 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284189 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mv6g\" (UniqueName: \"kubernetes.io/projected/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-kube-api-access-9mv6g\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:32.284281 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284236 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx6dh\" (UniqueName: \"kubernetes.io/projected/cfb5127e-d35c-4d71-9565-b8044e41f2bc-kube-api-access-sx6dh\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.284339 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284294 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-kubelet\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.284371 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284342 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-registration-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.284371 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284364 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-var-lib-kubelet\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.284434 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284386 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovn-node-metrics-cert\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.284434 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-host-slash\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:52:32.284487 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284465 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.284518 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284488 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-socket-dir-parent\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.284562 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284518 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-sys-fs\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.284562 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cni-binary-copy\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.284562 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284548 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.284689 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284574 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-lib-modules\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.284689 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.284689 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284624 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:32.284689 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284645 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/937459e4-a573-4d05-980b-b8c42db410f3-tmp\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.284689 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284669 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-systemd-units\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.284937 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284697 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-run-netns\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.284937 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284722 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xcw4\" (UniqueName: \"kubernetes.io/projected/754f74c1-4a21-4497-bdb6-9b8b1e97842a-kube-api-access-2xcw4\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.284937 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284738 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-cni-multus\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.284937 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284761 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-host\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:52:32.284937 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284796 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8rqr\" (UniqueName: \"kubernetes.io/projected/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-kube-api-access-s8rqr\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:52:32.284937 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284828 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgp75\" (UniqueName: \"kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75\") pod \"network-check-target-dxkrb\" (UID: \"c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b\") " pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:32.284937 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284870 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-system-cni-dir\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.284937 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284892 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-k8s-cni-cncf-io\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.284937 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284913 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmdvf\" (UniqueName: \"kubernetes.io/projected/937459e4-a573-4d05-980b-b8c42db410f3-kube-api-access-bmdvf\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.284937 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284934 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl2sc\" (UniqueName: \"kubernetes.io/projected/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-kube-api-access-jl2sc\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.284984 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-cni-binary-copy\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285006 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-conf-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285026 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-sys\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285046 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-slash\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-systemd\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285089 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-log-socket\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285110 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-device-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285130 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-node-log\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285188 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-netns\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285210 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285231 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysctl-d\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285259 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysctl-conf\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285280 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-var-lib-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285301 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-ovn\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285331 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovnkube-script-lib\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-serviceca\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:52:32.285377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285367 2580 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285373 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/967b7974-ef9d-4eff-8265-879c05e6fc96-dbus\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285480 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-systemd\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285507 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-run\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285528 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-hosts-file\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285560 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-cni-bin\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285583 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285605 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j794x\" (UniqueName: \"kubernetes.io/projected/4873d347-3f18-4861-986e-15785bfd25c3-kube-api-access-j794x\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285673 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/937459e4-a573-4d05-980b-b8c42db410f3-etc-tuned\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-cni-netd\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285702 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-system-cni-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285738 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-etc-kubernetes\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285761 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysconfig\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285792 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-run-ovn-kubernetes\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285817 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-cni-bin\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.286168 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285895 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-daemon-config\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.286843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285934 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62fhs\" (UniqueName: \"kubernetes.io/projected/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-kube-api-access-62fhs\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.286843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285958 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.286843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.285980 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-socket-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.286843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.286011 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-host\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.286843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.286034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-kubelet\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.286843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.286062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-env-overrides\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.286843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.286099 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-iptables-alerter-script\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:52:32.286843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.286120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt255\" (UniqueName: \"kubernetes.io/projected/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-kube-api-access-vt255\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:52:32.286843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.286135 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cnibin\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.286843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.286158 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-cni-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.286843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.286190 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-cnibin\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.286843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.286229 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-modprobe-d\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.286843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.286247 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovnkube-config\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.286843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.286260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-hostroot\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.304814 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.304793 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kln7l" Oct 30 21:52:32.314039 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.314024 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kln7l" Oct 30 21:52:32.346343 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.346264 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" event={"ID":"b10322e84c5fc9db7c569a5553b27b9d","Type":"ContainerStarted","Data":"b61a0e2e382177458b759f1f9b6113c77e16287ead5e9551e7e52381aa5f9096"} Oct 30 21:52:32.347522 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.347471 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" event={"ID":"4c692c4e8d6c927c981b5bf36ba589e2","Type":"ContainerStarted","Data":"cb7dda04a39fa37758507df57f0dc9002834e781ef8e334502efac6fe71b00ad"} Oct 30 21:52:32.355759 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.355731 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 21:52:32.355870 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.355770 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:52:32.355870 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.355789 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 21:52:32.355995 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.355978 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:52:32.356101 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.356088 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 21:52:32.356406 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.356389 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 21:52:32.356994 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.356979 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 21:52:32.357074 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.356989 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 21:52:32.357074 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.357050 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 21:52:32.357164 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.357085 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 21:52:32.357164 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.357129 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 21:52:32.357273 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.357261 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 21:52:32.357339 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.357329 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gpwbs\"" Oct 30 21:52:32.357390 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.357381 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 21:52:32.357434 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.357411 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 21:52:32.357482 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.357469 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 21:52:32.357532 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.357522 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kxljf\"" Oct 30 21:52:32.357898 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.357878 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 21:52:32.357985 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.357921 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 21:52:32.358036 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.358003 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 21:52:32.358067 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.358043 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 21:52:32.358511 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.358425 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 21:52:32.358511 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.358442 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 21:52:32.358511 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.358442 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4xh5g\"" Oct 30 21:52:32.358511 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.358443 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 21:52:32.358511 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.358488 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-hgb4n\"" Oct 30 21:52:32.358511 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.358503 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pzcl5\"" Oct 30 21:52:32.358799 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.358616 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 21:52:32.358799 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.358652 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 21:52:32.363246 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.360054 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 21:52:32.363246 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.360103 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-scccg\"" Oct 30 21:52:32.363246 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.360129 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ddnf5\"" Oct 30 21:52:32.363246 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.360620 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-7pfmv\"" Oct 30 21:52:32.375952 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.375935 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 21:52:32.382550 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.382528 2580 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:52:32.386624 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.386603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-kubernetes\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.386718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.386636 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.386718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.386661 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-tmp-dir\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:52:32.386718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.386682 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mv6g\" (UniqueName: \"kubernetes.io/projected/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-kube-api-access-9mv6g\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:32.386884 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.386705 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx6dh\" (UniqueName: \"kubernetes.io/projected/cfb5127e-d35c-4d71-9565-b8044e41f2bc-kube-api-access-sx6dh\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.386884 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.386747 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-kubelet\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.386884 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.386770 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-registration-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.386884 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.386790 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-var-lib-kubelet\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.386884 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.386820 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovn-node-metrics-cert\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.386884 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.386842 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-host-slash\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:52:32.387153 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.386895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.387153 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.386919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-socket-dir-parent\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.387153 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.386940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-sys-fs\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.387153 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.386964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cni-binary-copy\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.387153 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.386986 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.387153 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387008 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-lib-modules\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.387153 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387066 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.387153 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387090 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:32.387153 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387111 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/937459e4-a573-4d05-980b-b8c42db410f3-tmp\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.387153 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387131 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-systemd-units\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.387153 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387151 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-run-netns\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387174 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xcw4\" (UniqueName: \"kubernetes.io/projected/754f74c1-4a21-4497-bdb6-9b8b1e97842a-kube-api-access-2xcw4\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387179 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-kubernetes\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-cni-multus\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387203 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-tmp-dir\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387218 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-host\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387241 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8rqr\" (UniqueName: \"kubernetes.io/projected/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-kube-api-access-s8rqr\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgp75\" (UniqueName: \"kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75\") pod \"network-check-target-dxkrb\" (UID: \"c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b\") " pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387266 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387285 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-system-cni-dir\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387309 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-k8s-cni-cncf-io\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387331 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmdvf\" (UniqueName: \"kubernetes.io/projected/937459e4-a573-4d05-980b-b8c42db410f3-kube-api-access-bmdvf\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387351 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-host-slash\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387353 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl2sc\" (UniqueName: \"kubernetes.io/projected/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-kube-api-access-jl2sc\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.387371 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387374 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-lib-modules\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387393 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-cni-binary-copy\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.387604 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.387417 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs podName:b6b30cd9-d376-4e9e-8f95-d4d2c504cd93 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:32.887403168 +0000 UTC m=+2.994768911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs") pod "network-metrics-daemon-ztlk7" (UID: "b6b30cd9-d376-4e9e-8f95-d4d2c504cd93") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387430 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-conf-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387448 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-sys\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387462 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-slash\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-systemd\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-log-socket\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387514 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-device-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387531 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57645c9d-50be-44cf-8ae7-c0c3103b2a78-konnectivity-ca\") pod \"konnectivity-agent-25wb5\" (UID: \"57645c9d-50be-44cf-8ae7-c0c3103b2a78\") " pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387562 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-node-log\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-netns\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387574 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-cni-multus\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387589 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57645c9d-50be-44cf-8ae7-c0c3103b2a78-agent-certs\") pod \"konnectivity-agent-25wb5\" (UID: \"57645c9d-50be-44cf-8ae7-c0c3103b2a78\") " pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387607 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387618 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-host\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysctl-d\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387654 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysctl-conf\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387682 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-var-lib-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387697 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysctl-d\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.388366 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387705 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-ovn\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387730 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovnkube-script-lib\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-serviceca\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/967b7974-ef9d-4eff-8265-879c05e6fc96-dbus\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387806 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-systemd\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387829 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-run\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387876 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-hosts-file\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-cni-bin\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387912 2580 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387922 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-cni-binary-copy\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387931 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387922 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j794x\" (UniqueName: \"kubernetes.io/projected/4873d347-3f18-4861-986e-15785bfd25c3-kube-api-access-j794x\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.387994 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-kubelet\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/937459e4-a573-4d05-980b-b8c42db410f3-etc-tuned\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388024 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-socket-dir-parent\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388052 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-cni-netd\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388076 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-system-cni-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.389158 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-etc-kubernetes\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388122 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysconfig\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388145 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-run-ovn-kubernetes\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388206 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-sys-fs\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388465 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-system-cni-dir\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388479 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cni-binary-copy\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388523 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-k8s-cni-cncf-io\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388576 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388601 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-cni-netd\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388633 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-system-cni-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388666 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-systemd-units\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388671 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysconfig\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388698 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-var-lib-kubelet\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388707 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-etc-kubernetes\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388713 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-registration-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388745 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-var-lib-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388752 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-ovn\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.389992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388783 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-run-netns\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388876 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-conf-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388920 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-sys\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388924 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-hosts-file\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388954 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-slash\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.388986 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-systemd\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389019 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-log-socket\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389064 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-device-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389092 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389114 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-node-log\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.389162 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.389199 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret podName:967b7974-ef9d-4eff-8265-879c05e6fc96 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:32.88918709 +0000 UTC m=+2.996552834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret") pod "global-pull-secret-syncer-s5jhm" (UID: "967b7974-ef9d-4eff-8265-879c05e6fc96") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389221 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389232 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-netns\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389259 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-cni-bin\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389293 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-systemd\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389316 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-cni-bin\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389332 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-run\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.390729 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389338 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-serviceca\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389379 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-cni-bin\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389353 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/967b7974-ef9d-4eff-8265-879c05e6fc96-dbus\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389339 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-daemon-config\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62fhs\" (UniqueName: \"kubernetes.io/projected/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-kube-api-access-62fhs\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389380 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-run-ovn-kubernetes\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389464 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389536 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389560 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-socket-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389709 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-socket-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389713 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-host\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-kubelet\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389770 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-env-overrides\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389772 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-host\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-iptables-alerter-script\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:52:32.391396 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389821 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-kubelet\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389838 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt255\" (UniqueName: \"kubernetes.io/projected/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-kube-api-access-vt255\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389880 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cnibin\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389902 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-cni-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-cnibin\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389942 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-modprobe-d\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389963 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovnkube-config\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389965 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-daemon-config\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.389983 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-hostroot\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.390007 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-multus-certs\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.390027 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/967b7974-ef9d-4eff-8265-879c05e6fc96-kubelet-config\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.390041 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-cni-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.390050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-etc-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.390084 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cnibin\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.390113 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-etc-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.390150 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-multus-certs\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.390161 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/967b7974-ef9d-4eff-8265-879c05e6fc96-kubelet-config\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.390195 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-hostroot\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.391991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.390208 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-cnibin\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.392538 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.390241 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysctl-conf\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.392538 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.390243 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-modprobe-d\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.392538 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.390931 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-iptables-alerter-script\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:52:32.392538 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.391062 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-env-overrides\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.392538 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.391130 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/937459e4-a573-4d05-980b-b8c42db410f3-etc-tuned\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.392538 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.391171 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/937459e4-a573-4d05-980b-b8c42db410f3-tmp\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.392538 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.391404 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovn-node-metrics-cert\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.392538 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.391467 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovnkube-config\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.392538 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.391581 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovnkube-script-lib\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.399873 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.399828 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx6dh\" (UniqueName: \"kubernetes.io/projected/cfb5127e-d35c-4d71-9565-b8044e41f2bc-kube-api-access-sx6dh\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.400509 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.400489 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:52:32.400588 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.400515 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:52:32.400588 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.400527 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zgp75 for pod openshift-network-diagnostics/network-check-target-dxkrb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:32.400588 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.400577 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75 podName:c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b nodeName:}" failed. No retries permitted until 2026-10-30 21:52:32.900562446 +0000 UTC m=+3.007928195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zgp75" (UniqueName: "kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75") pod "network-check-target-dxkrb" (UID: "c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:32.401569 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.401548 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmdvf\" (UniqueName: \"kubernetes.io/projected/937459e4-a573-4d05-980b-b8c42db410f3-kube-api-access-bmdvf\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.401746 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.401727 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j794x\" (UniqueName: \"kubernetes.io/projected/4873d347-3f18-4861-986e-15785bfd25c3-kube-api-access-j794x\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.402900 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.402879 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl2sc\" (UniqueName: \"kubernetes.io/projected/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-kube-api-access-jl2sc\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:52:32.404907 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.404887 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mv6g\" (UniqueName: \"kubernetes.io/projected/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-kube-api-access-9mv6g\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:32.404991 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.404891 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62fhs\" (UniqueName: \"kubernetes.io/projected/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-kube-api-access-62fhs\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.405309 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.405291 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt255\" (UniqueName: \"kubernetes.io/projected/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-kube-api-access-vt255\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:52:32.405372 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.405292 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8rqr\" (UniqueName: \"kubernetes.io/projected/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-kube-api-access-s8rqr\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:52:32.406909 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.406890 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xcw4\" (UniqueName: \"kubernetes.io/projected/754f74c1-4a21-4497-bdb6-9b8b1e97842a-kube-api-access-2xcw4\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.490830 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.490801 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57645c9d-50be-44cf-8ae7-c0c3103b2a78-konnectivity-ca\") pod \"konnectivity-agent-25wb5\" (UID: \"57645c9d-50be-44cf-8ae7-c0c3103b2a78\") " pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:52:32.490830 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.490829 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57645c9d-50be-44cf-8ae7-c0c3103b2a78-agent-certs\") pod \"konnectivity-agent-25wb5\" (UID: \"57645c9d-50be-44cf-8ae7-c0c3103b2a78\") " pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:52:32.491309 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.491291 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57645c9d-50be-44cf-8ae7-c0c3103b2a78-konnectivity-ca\") pod \"konnectivity-agent-25wb5\" (UID: \"57645c9d-50be-44cf-8ae7-c0c3103b2a78\") " pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:52:32.493345 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.493317 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57645c9d-50be-44cf-8ae7-c0c3103b2a78-agent-certs\") pod \"konnectivity-agent-25wb5\" (UID: \"57645c9d-50be-44cf-8ae7-c0c3103b2a78\") " pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:52:32.576039 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.575970 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4d225" Oct 30 21:52:32.587311 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.587112 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:52:32.587532 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:32.587505 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4e36e4_7ca2_4e4f_837d_ebdef77734b1.slice/crio-20fc85f8d6d291e0d7f776ff749acf65625502e219981cdde576c389c75bfc37 WatchSource:0}: Error finding container 20fc85f8d6d291e0d7f776ff749acf65625502e219981cdde576c389c75bfc37: Status 404 returned error can't find the container with id 20fc85f8d6d291e0d7f776ff749acf65625502e219981cdde576c389c75bfc37 Oct 30 21:52:32.595353 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:32.595330 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937459e4_a573_4d05_980b_b8c42db410f3.slice/crio-72f74999f03eba93618123016c8d6772a758e064aeff5c547517188dfb5f420d WatchSource:0}: Error finding container 72f74999f03eba93618123016c8d6772a758e064aeff5c547517188dfb5f420d: Status 404 returned error can't find the container with id 72f74999f03eba93618123016c8d6772a758e064aeff5c547517188dfb5f420d Oct 30 21:52:32.610324 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.610300 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:52:32.610414 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.610355 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:52:32.618029 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.617878 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7s4gp" Oct 30 21:52:32.621594 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:32.621570 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc21c8c5_43ec_4e83_8cf7_5d0d5d4d109a.slice/crio-0ca0363e3b421603ecee03e9d872eb681f1d3f7d3d000ee7d5277ece7cb0303e WatchSource:0}: Error finding container 0ca0363e3b421603ecee03e9d872eb681f1d3f7d3d000ee7d5277ece7cb0303e: Status 404 returned error can't find the container with id 0ca0363e3b421603ecee03e9d872eb681f1d3f7d3d000ee7d5277ece7cb0303e Oct 30 21:52:32.625145 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:32.625100 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb5127e_d35c_4d71_9565_b8044e41f2bc.slice/crio-c8c5de1d9c32247911a979df12937d30ad8c5df8374bc2c33fecec98e7c207b0 WatchSource:0}: Error finding container c8c5de1d9c32247911a979df12937d30ad8c5df8374bc2c33fecec98e7c207b0: Status 404 returned error can't find the container with id c8c5de1d9c32247911a979df12937d30ad8c5df8374bc2c33fecec98e7c207b0 Oct 30 21:52:32.627163 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.627144 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:52:32.629686 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.629640 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:32.635580 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.635312 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:52:32.636323 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.636283 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:52:32.637597 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:32.637523 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4873d347_3f18_4861_986e_15785bfd25c3.slice/crio-23ffbb0199c49cd7832a36265d949f8d61fcbdcdc706226d93000220888736a3 WatchSource:0}: Error finding container 23ffbb0199c49cd7832a36265d949f8d61fcbdcdc706226d93000220888736a3: Status 404 returned error can't find the container with id 23ffbb0199c49cd7832a36265d949f8d61fcbdcdc706226d93000220888736a3 Oct 30 21:52:32.648759 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:32.648726 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23d7533_e36d_460f_b8f4_18d4f38dd0e7.slice/crio-258c752a743a933baca8466330ce2843b48d7ca189e06e0cd17bc2ee5758d076 WatchSource:0}: Error finding container 258c752a743a933baca8466330ce2843b48d7ca189e06e0cd17bc2ee5758d076: Status 404 returned error can't find the container with id 258c752a743a933baca8466330ce2843b48d7ca189e06e0cd17bc2ee5758d076 Oct 30 21:52:32.650497 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:32.650479 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57645c9d_50be_44cf_8ae7_c0c3103b2a78.slice/crio-fc430f158552530ba6401eac6341dd6f783809e5b1127af5442004c5ebfeb4de WatchSource:0}: Error finding container fc430f158552530ba6401eac6341dd6f783809e5b1127af5442004c5ebfeb4de: Status 404 returned error can't find the container with id fc430f158552530ba6401eac6341dd6f783809e5b1127af5442004c5ebfeb4de Oct 30 21:52:32.893739 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.893665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:32.893739 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.893721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:32.893920 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.893813 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:32.893920 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.893869 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:32.893920 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.893890 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret podName:967b7974-ef9d-4eff-8265-879c05e6fc96 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:33.893877579 +0000 UTC m=+4.001243306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret") pod "global-pull-secret-syncer-s5jhm" (UID: "967b7974-ef9d-4eff-8265-879c05e6fc96") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:32.894031 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.893925 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs podName:b6b30cd9-d376-4e9e-8f95-d4d2c504cd93 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:33.893908397 +0000 UTC m=+4.001274138 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs") pod "network-metrics-daemon-ztlk7" (UID: "b6b30cd9-d376-4e9e-8f95-d4d2c504cd93") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:32.994095 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:32.994064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgp75\" (UniqueName: \"kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75\") pod \"network-check-target-dxkrb\" (UID: \"c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b\") " pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:32.994211 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.994197 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:52:32.994245 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.994215 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:52:32.994245 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.994224 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zgp75 for pod openshift-network-diagnostics/network-check-target-dxkrb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:32.994344 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:32.994262 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75 podName:c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b nodeName:}" failed. No retries permitted until 2026-10-30 21:52:33.994250296 +0000 UTC m=+4.101616023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zgp75" (UniqueName: "kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75") pod "network-check-target-dxkrb" (UID: "c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:33.316747 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.316486 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:47:32 +0000 UTC" deadline="2028-06-12 11:18:52.409214401 +0000 UTC" Oct 30 21:52:33.316747 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.316745 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14173h26m19.092473841s" Oct 30 21:52:33.342427 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.342400 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:33.342570 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:33.342509 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxkrb" podUID="c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b" Oct 30 21:52:33.352275 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.352246 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hchhj" event={"ID":"937459e4-a573-4d05-980b-b8c42db410f3","Type":"ContainerStarted","Data":"72f74999f03eba93618123016c8d6772a758e064aeff5c547517188dfb5f420d"} Oct 30 21:52:33.354901 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.354876 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4d225" event={"ID":"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1","Type":"ContainerStarted","Data":"20fc85f8d6d291e0d7f776ff749acf65625502e219981cdde576c389c75bfc37"} Oct 30 21:52:33.359419 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.359393 2580 generic.go:356] "Generic (PLEG): container finished" podID="4c692c4e8d6c927c981b5bf36ba589e2" containerID="f4b93e70b6487b6df07b8f2931a5271d866f26f4198dc92ca48e74890ab8e7a8" exitCode=0 Oct 30 21:52:33.359522 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.359465 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" event={"ID":"4c692c4e8d6c927c981b5bf36ba589e2","Type":"ContainerDied","Data":"f4b93e70b6487b6df07b8f2931a5271d866f26f4198dc92ca48e74890ab8e7a8"} Oct 30 21:52:33.362448 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.362423 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-npvbd" event={"ID":"e23d7533-e36d-460f-b8f4-18d4f38dd0e7","Type":"ContainerStarted","Data":"258c752a743a933baca8466330ce2843b48d7ca189e06e0cd17bc2ee5758d076"} Oct 30 21:52:33.368565 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.368506 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" event={"ID":"4873d347-3f18-4861-986e-15785bfd25c3","Type":"ContainerStarted","Data":"23ffbb0199c49cd7832a36265d949f8d61fcbdcdc706226d93000220888736a3"} Oct 30 21:52:33.376885 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.376778 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7s4gp" event={"ID":"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1","Type":"ContainerStarted","Data":"cc67bb738cf00008f91ff3c92a67d0dd44cbf445e7f6fa28fd011cce39044001"} Oct 30 21:52:33.383976 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.383909 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dgfl4" event={"ID":"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a","Type":"ContainerStarted","Data":"0ca0363e3b421603ecee03e9d872eb681f1d3f7d3d000ee7d5277ece7cb0303e"} Oct 30 21:52:33.387850 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.387209 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" event={"ID":"b10322e84c5fc9db7c569a5553b27b9d","Type":"ContainerStarted","Data":"6c140bb6b1e3892c0ee16ee6e41084b1214a99f0561da62cbfe5bc00517bdb13"} Oct 30 21:52:33.391766 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.391693 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-25wb5" event={"ID":"57645c9d-50be-44cf-8ae7-c0c3103b2a78","Type":"ContainerStarted","Data":"fc430f158552530ba6401eac6341dd6f783809e5b1127af5442004c5ebfeb4de"} Oct 30 21:52:33.393213 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.393105 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" event={"ID":"754f74c1-4a21-4497-bdb6-9b8b1e97842a","Type":"ContainerStarted","Data":"2180bd7afa382e181f34312015a13a50ee178d4a05a7191f969d0a9cf7cba3d1"} Oct 30 21:52:33.395589 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.395520 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpw8h" event={"ID":"cfb5127e-d35c-4d71-9565-b8044e41f2bc","Type":"ContainerStarted","Data":"c8c5de1d9c32247911a979df12937d30ad8c5df8374bc2c33fecec98e7c207b0"} Oct 30 21:52:33.903686 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.903611 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:33.903899 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:33.903690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:33.903899 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:33.903829 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:33.904026 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:33.903937 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:33.904026 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:33.903987 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs podName:b6b30cd9-d376-4e9e-8f95-d4d2c504cd93 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:35.903969367 +0000 UTC m=+6.011335101 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs") pod "network-metrics-daemon-ztlk7" (UID: "b6b30cd9-d376-4e9e-8f95-d4d2c504cd93") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:33.904470 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:33.904453 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret podName:967b7974-ef9d-4eff-8265-879c05e6fc96 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:35.904434019 +0000 UTC m=+6.011799755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret") pod "global-pull-secret-syncer-s5jhm" (UID: "967b7974-ef9d-4eff-8265-879c05e6fc96") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:34.004105 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:34.004071 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgp75\" (UniqueName: \"kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75\") pod \"network-check-target-dxkrb\" (UID: \"c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b\") " pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:34.004274 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:34.004259 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:52:34.004328 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:34.004282 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:52:34.004328 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:34.004294 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zgp75 for pod openshift-network-diagnostics/network-check-target-dxkrb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:34.004514 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:34.004344 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75 podName:c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b nodeName:}" failed. No retries permitted until 2026-10-30 21:52:36.00432859 +0000 UTC m=+6.111694323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zgp75" (UniqueName: "kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75") pod "network-check-target-dxkrb" (UID: "c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:34.317239 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:34.317201 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:47:32 +0000 UTC" deadline="2028-03-29 15:20:32.588842308 +0000 UTC" Oct 30 21:52:34.317239 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:34.317237 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12377h27m58.271609755s" Oct 30 21:52:34.343028 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:34.342982 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:34.343206 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:34.343130 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ztlk7" podUID="b6b30cd9-d376-4e9e-8f95-d4d2c504cd93" Oct 30 21:52:34.343206 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:34.343177 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:34.343319 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:34.343293 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5jhm" podUID="967b7974-ef9d-4eff-8265-879c05e6fc96" Oct 30 21:52:34.433429 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:34.433395 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" event={"ID":"4c692c4e8d6c927c981b5bf36ba589e2","Type":"ContainerStarted","Data":"9bc313b97460ec163a7489726d1224d1367d9adeabae7ce36d85f93cff00434e"} Oct 30 21:52:34.451087 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:34.451026 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" podStartSLOduration=3.451007646 podStartE2EDuration="3.451007646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:33.403851972 +0000 UTC m=+3.511217724" watchObservedRunningTime="2026-10-30 21:52:34.451007646 +0000 UTC m=+4.558373398" Oct 30 21:52:34.451239 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:34.451165 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" podStartSLOduration=3.451157828 podStartE2EDuration="3.451157828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:34.4506855 +0000 UTC m=+4.558051253" watchObservedRunningTime="2026-10-30 21:52:34.451157828 +0000 UTC m=+4.558523580" Oct 30 21:52:35.343429 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:35.342945 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:35.343429 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:35.343071 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxkrb" podUID="c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b" Oct 30 21:52:35.450270 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:35.450233 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpw8h" event={"ID":"cfb5127e-d35c-4d71-9565-b8044e41f2bc","Type":"ContainerStarted","Data":"ba66e007417e9f11ca9aeb675f187517f725e51988b96a8eb6ff7d439b698afe"} Oct 30 21:52:35.920853 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:35.920817 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:35.921045 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:35.920898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:35.921148 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:35.921128 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:35.921219 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:35.921206 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs podName:b6b30cd9-d376-4e9e-8f95-d4d2c504cd93 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:39.921186577 +0000 UTC m=+10.028552320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs") pod "network-metrics-daemon-ztlk7" (UID: "b6b30cd9-d376-4e9e-8f95-d4d2c504cd93") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:35.921634 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:35.921613 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:35.921732 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:35.921681 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret podName:967b7974-ef9d-4eff-8265-879c05e6fc96 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:39.921666112 +0000 UTC m=+10.029031853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret") pod "global-pull-secret-syncer-s5jhm" (UID: "967b7974-ef9d-4eff-8265-879c05e6fc96") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:36.021883 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:36.021833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgp75\" (UniqueName: \"kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75\") pod \"network-check-target-dxkrb\" (UID: \"c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b\") " pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:36.022079 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:36.022063 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:52:36.022165 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:36.022090 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:52:36.022165 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:36.022102 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zgp75 for pod openshift-network-diagnostics/network-check-target-dxkrb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:36.022165 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:36.022158 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75 podName:c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b nodeName:}" failed. No retries permitted until 2026-10-30 21:52:40.022139454 +0000 UTC m=+10.129505198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zgp75" (UniqueName: "kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75") pod "network-check-target-dxkrb" (UID: "c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:36.343561 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:36.343063 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:36.343561 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:36.343108 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:36.343561 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:36.343210 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5jhm" podUID="967b7974-ef9d-4eff-8265-879c05e6fc96" Oct 30 21:52:36.343561 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:36.343347 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ztlk7" podUID="b6b30cd9-d376-4e9e-8f95-d4d2c504cd93" Oct 30 21:52:36.453618 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:36.453581 2580 generic.go:356] "Generic (PLEG): container finished" podID="cfb5127e-d35c-4d71-9565-b8044e41f2bc" containerID="ba66e007417e9f11ca9aeb675f187517f725e51988b96a8eb6ff7d439b698afe" exitCode=0 Oct 30 21:52:36.453725 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:36.453647 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpw8h" event={"ID":"cfb5127e-d35c-4d71-9565-b8044e41f2bc","Type":"ContainerDied","Data":"ba66e007417e9f11ca9aeb675f187517f725e51988b96a8eb6ff7d439b698afe"} Oct 30 21:52:37.342432 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:37.342358 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:37.342586 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:37.342504 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxkrb" podUID="c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b" Oct 30 21:52:37.460640 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:37.460563 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-25wb5" event={"ID":"57645c9d-50be-44cf-8ae7-c0c3103b2a78","Type":"ContainerStarted","Data":"27ba5a856dbceaa0a89f3b7caa2a47c08cc3e5f391c12f1328aab861d44422c8"} Oct 30 21:52:37.465254 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:37.465225 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dgfl4" event={"ID":"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a","Type":"ContainerStarted","Data":"5894b6b05397bd1a650419078c65addd52f2621e9750ce10fdb76bcb3b0f1e06"} Oct 30 21:52:37.479330 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:37.479278 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-25wb5" podStartSLOduration=3.720713014 podStartE2EDuration="7.479261849s" totalImagesPullingTime="3.758548835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:37.478810887 +0000 UTC m=+7.586176643" watchObservedRunningTime="2026-10-30 21:52:37.479261849 +0000 UTC m=+7.586627603" Oct 30 21:52:38.343514 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:38.342979 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:38.343514 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:38.343036 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:38.343514 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:38.343132 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ztlk7" podUID="b6b30cd9-d376-4e9e-8f95-d4d2c504cd93" Oct 30 21:52:38.343514 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:38.343248 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5jhm" podUID="967b7974-ef9d-4eff-8265-879c05e6fc96" Oct 30 21:52:38.470883 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:38.470627 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" event={"ID":"4873d347-3f18-4861-986e-15785bfd25c3","Type":"ContainerStarted","Data":"c3f5661554b85cf3a03b659dd01dfcfdfcedafa4c777da97f6d4d4f75cd2e906"} Oct 30 21:52:39.342479 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:39.342443 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:39.342674 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:39.342576 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxkrb" podUID="c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b" Oct 30 21:52:39.858576 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:39.858551 2580 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 21:52:39.955026 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:39.954950 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:39.955185 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:39.955029 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:39.955185 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:39.955146 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:39.955297 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:39.955210 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs podName:b6b30cd9-d376-4e9e-8f95-d4d2c504cd93 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:47.955191704 +0000 UTC m=+18.062557454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs") pod "network-metrics-daemon-ztlk7" (UID: "b6b30cd9-d376-4e9e-8f95-d4d2c504cd93") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:39.955576 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:39.955558 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:39.955639 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:39.955614 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret podName:967b7974-ef9d-4eff-8265-879c05e6fc96 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:47.95559968 +0000 UTC m=+18.062965423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret") pod "global-pull-secret-syncer-s5jhm" (UID: "967b7974-ef9d-4eff-8265-879c05e6fc96") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:39.997783 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:39.997091 2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:52:39.998317 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:39.998085 2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:52:40.016003 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:40.015949 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dgfl4" podStartSLOduration=5.445084484 podStartE2EDuration="10.01593259s" totalImagesPullingTime="4.570848106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:37.496621599 +0000 UTC m=+7.603987347" watchObservedRunningTime="2026-10-30 21:52:40.01593259 +0000 UTC m=+10.123298341" Oct 30 21:52:40.056273 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:40.055833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgp75\" (UniqueName: \"kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75\") pod \"network-check-target-dxkrb\" (UID: \"c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b\") " pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:40.056273 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:40.056014 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:52:40.056273 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:40.056038 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:52:40.056273 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:40.056052 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zgp75 for pod openshift-network-diagnostics/network-check-target-dxkrb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:40.056273 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:40.056110 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75 podName:c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b nodeName:}" failed. No retries permitted until 2026-10-30 21:52:48.056091766 +0000 UTC m=+18.163457509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zgp75" (UniqueName: "kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75") pod "network-check-target-dxkrb" (UID: "c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:40.344531 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:40.343027 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:40.344531 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:40.343116 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5jhm" podUID="967b7974-ef9d-4eff-8265-879c05e6fc96" Oct 30 21:52:40.344531 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:40.343455 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:40.344531 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:40.343560 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ztlk7" podUID="b6b30cd9-d376-4e9e-8f95-d4d2c504cd93" Oct 30 21:52:40.344531 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:40.344253 2580 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:52:39.85857364Z","UUID":"c5e1b26b-1d38-4dd9-ae1b-d1f68303a6c8","Handler":null,"Name":"","Endpoint":""} Oct 30 21:52:40.346325 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:40.345841 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 21:52:40.346325 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:40.345887 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 21:52:40.478290 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:40.478092 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4d225" event={"ID":"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1","Type":"ContainerStarted","Data":"9d5d3d740980eb5157eaff1895fa75759d3639b628affaa3d6e8f442ab420eae"} Oct 30 21:52:40.481028 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:40.481000 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" event={"ID":"4873d347-3f18-4861-986e-15785bfd25c3","Type":"ContainerStarted","Data":"5ccb9201a26a1224972a52677dcdf9b9ef13e2af99127bedca0f9c9dc4538d04"} Oct 30 21:52:40.483323 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:40.483298 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7s4gp" event={"ID":"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1","Type":"ContainerStarted","Data":"707c1236ca357023610d23e90ddf25f6ab931337d3c5520cc3c9cf66a63db783"} Oct 30 21:52:40.483420 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:40.483343 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:52:40.483615 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:40.483599 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:52:40.497517 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:40.496902 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-4d225" podStartSLOduration=2.886653332 podStartE2EDuration="10.496891961s" totalImagesPullingTime="7.610238629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:40.496600616 +0000 UTC m=+10.603966369" watchObservedRunningTime="2026-10-30 21:52:40.496891961 +0000 UTC m=+10.604257711" Oct 30 21:52:40.550214 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:40.550168 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-7s4gp" podStartSLOduration=2.9789000960000003 podStartE2EDuration="10.550155495s" totalImagesPullingTime="7.571255399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:40.527548824 +0000 UTC m=+10.634914577" watchObservedRunningTime="2026-10-30 21:52:40.550155495 +0000 UTC m=+10.657521243" Oct 30 21:52:41.343007 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:41.342971 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:41.343476 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:41.343082 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxkrb" podUID="c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b" Oct 30 21:52:41.486983 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:41.486944 2580 generic.go:356] "Generic (PLEG): container finished" podID="cfb5127e-d35c-4d71-9565-b8044e41f2bc" containerID="dd62555289368901e74b2210e0e3001e5e507bfb4cea4f98eba3c2f4cc675ed6" exitCode=0 Oct 30 21:52:41.487152 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:41.487048 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpw8h" event={"ID":"cfb5127e-d35c-4d71-9565-b8044e41f2bc","Type":"ContainerDied","Data":"dd62555289368901e74b2210e0e3001e5e507bfb4cea4f98eba3c2f4cc675ed6"} Oct 30 21:52:41.489674 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:41.489648 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" event={"ID":"4873d347-3f18-4861-986e-15785bfd25c3","Type":"ContainerStarted","Data":"2581aee4dc45c6360002f8e894c65a6cce1e94cb76c72b847e749aaccc429d4e"} Oct 30 21:52:41.534478 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:41.534431 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" podStartSLOduration=3.654461092 podStartE2EDuration="11.534417757s" totalImagesPullingTime="7.879956665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:41.534009385 +0000 UTC m=+11.641375196" watchObservedRunningTime="2026-10-30 21:52:41.534417757 +0000 UTC m=+11.641783507" Oct 30 21:52:42.342819 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:42.342782 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:42.342978 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:42.342782 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:42.343048 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:42.342972 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5jhm" podUID="967b7974-ef9d-4eff-8265-879c05e6fc96" Oct 30 21:52:42.343048 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:42.343014 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ztlk7" podUID="b6b30cd9-d376-4e9e-8f95-d4d2c504cd93" Oct 30 21:52:42.493907 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:42.493880 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hchhj" event={"ID":"937459e4-a573-4d05-980b-b8c42db410f3","Type":"ContainerStarted","Data":"02a2a81cb411ddff4d818b19f2c84a33586f83db9dab31e92740309cd2cc9399"} Oct 30 21:52:42.498438 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:42.497230 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-npvbd" event={"ID":"e23d7533-e36d-460f-b8f4-18d4f38dd0e7","Type":"ContainerStarted","Data":"0d8d132f6b475dcc9a399fb4ef3b11ce7a196b2307a40feb986011333bbc1b5d"} Oct 30 21:52:42.514949 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:42.514907 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hchhj" podStartSLOduration=2.948165326 podStartE2EDuration="12.514895232s" totalImagesPullingTime="9.566729906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:42.513698666 +0000 UTC m=+12.621064414" watchObservedRunningTime="2026-10-30 21:52:42.514895232 +0000 UTC m=+12.622260982" Oct 30 21:52:43.343437 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:43.343406 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:43.344031 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:43.343533 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxkrb" podUID="c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b" Oct 30 21:52:43.500472 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:43.500439 2580 generic.go:356] "Generic (PLEG): container finished" podID="cfb5127e-d35c-4d71-9565-b8044e41f2bc" containerID="851cd0569415566420a95756da3d38a9de55543d0a05ca13a3d51274535d3301" exitCode=0 Oct 30 21:52:43.500630 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:43.500529 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpw8h" event={"ID":"cfb5127e-d35c-4d71-9565-b8044e41f2bc","Type":"ContainerDied","Data":"851cd0569415566420a95756da3d38a9de55543d0a05ca13a3d51274535d3301"} Oct 30 21:52:43.527453 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:43.527400 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-npvbd" podStartSLOduration=5.9258061380000004 podStartE2EDuration="13.527381526s" totalImagesPullingTime="7.601575388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:42.529743322 +0000 UTC m=+12.637109066" watchObservedRunningTime="2026-10-30 21:52:43.527381526 +0000 UTC m=+13.634747279" Oct 30 21:52:44.344167 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:44.343969 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:44.344533 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:44.344004 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:44.344533 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:44.344278 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5jhm" podUID="967b7974-ef9d-4eff-8265-879c05e6fc96" Oct 30 21:52:44.344533 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:44.344387 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ztlk7" podUID="b6b30cd9-d376-4e9e-8f95-d4d2c504cd93" Oct 30 21:52:44.504957 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:44.504926 2580 generic.go:356] "Generic (PLEG): container finished" podID="cfb5127e-d35c-4d71-9565-b8044e41f2bc" containerID="79ea3a7bc30a6b393cb3369eaa3c3ec9857288bd5a900a7cd1fd88a600d0750f" exitCode=0 Oct 30 21:52:44.505064 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:44.504987 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpw8h" event={"ID":"cfb5127e-d35c-4d71-9565-b8044e41f2bc","Type":"ContainerDied","Data":"79ea3a7bc30a6b393cb3369eaa3c3ec9857288bd5a900a7cd1fd88a600d0750f"} Oct 30 21:52:45.343176 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:45.343144 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:45.343347 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:45.343267 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxkrb" podUID="c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b" Oct 30 21:52:46.342893 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:46.342844 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:46.342893 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:46.342897 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:46.343298 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:46.342977 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5jhm" podUID="967b7974-ef9d-4eff-8265-879c05e6fc96" Oct 30 21:52:46.343298 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:46.343097 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ztlk7" podUID="b6b30cd9-d376-4e9e-8f95-d4d2c504cd93" Oct 30 21:52:47.342636 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:47.342616 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:47.342756 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:47.342731 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxkrb" podUID="c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b" Oct 30 21:52:47.513440 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:47.513409 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" event={"ID":"754f74c1-4a21-4497-bdb6-9b8b1e97842a","Type":"ContainerStarted","Data":"593f02e4d1b972730df9822d75a83b2ea462d8ef36304db5317e9b2bb4d391da"} Oct 30 21:52:47.513852 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:47.513491 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" event={"ID":"754f74c1-4a21-4497-bdb6-9b8b1e97842a","Type":"ContainerStarted","Data":"3b5c841ccf2c4fad667bfa172ee96ac18ff4109d4d4c5becc0269c31e9dd6509"} Oct 30 21:52:47.513852 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:47.513537 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" event={"ID":"754f74c1-4a21-4497-bdb6-9b8b1e97842a","Type":"ContainerStarted","Data":"04892882c4c749e75d3311cbd8083ba1be7e692ca8885b659add6b03f6790ac5"} Oct 30 21:52:47.513852 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:47.513566 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" event={"ID":"754f74c1-4a21-4497-bdb6-9b8b1e97842a","Type":"ContainerStarted","Data":"f82b760310e2061de339cd1da13564231f195b20aa0b8c7193d23efaea563c80"} Oct 30 21:52:47.513852 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:47.513607 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" event={"ID":"754f74c1-4a21-4497-bdb6-9b8b1e97842a","Type":"ContainerStarted","Data":"3e47729cf0e09a1968b8553cf781304f1b3df364bf7a54a5677c9a341d956a7b"} Oct 30 21:52:47.513852 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:47.513641 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" event={"ID":"754f74c1-4a21-4497-bdb6-9b8b1e97842a","Type":"ContainerStarted","Data":"d9bacf7120f4286ac748f26d9bda1ad5cdf1c36dc514e71eaf02666648700626"} Oct 30 21:52:47.515988 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:47.515965 2580 generic.go:356] "Generic (PLEG): container finished" podID="cfb5127e-d35c-4d71-9565-b8044e41f2bc" containerID="bf36c2895f43b0d56bd60d6bec76a52225da7fa6ef8af1198704685c690ce5ca" exitCode=0 Oct 30 21:52:47.516077 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:47.516002 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpw8h" event={"ID":"cfb5127e-d35c-4d71-9565-b8044e41f2bc","Type":"ContainerDied","Data":"bf36c2895f43b0d56bd60d6bec76a52225da7fa6ef8af1198704685c690ce5ca"} Oct 30 21:52:48.018733 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:48.018701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:48.018895 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:48.018744 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:48.018895 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:48.018837 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:48.018895 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:48.018841 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:48.019008 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:48.018897 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret podName:967b7974-ef9d-4eff-8265-879c05e6fc96 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:04.018883773 +0000 UTC m=+34.126249516 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret") pod "global-pull-secret-syncer-s5jhm" (UID: "967b7974-ef9d-4eff-8265-879c05e6fc96") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:48.019008 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:48.018910 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs podName:b6b30cd9-d376-4e9e-8f95-d4d2c504cd93 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:04.018904658 +0000 UTC m=+34.126270387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs") pod "network-metrics-daemon-ztlk7" (UID: "b6b30cd9-d376-4e9e-8f95-d4d2c504cd93") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:48.119737 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:48.119708 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgp75\" (UniqueName: \"kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75\") pod \"network-check-target-dxkrb\" (UID: \"c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b\") " pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:48.119876 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:48.119822 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:52:48.119876 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:48.119834 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:52:48.119876 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:48.119842 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zgp75 for pod openshift-network-diagnostics/network-check-target-dxkrb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:48.119994 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:48.119896 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75 podName:c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b nodeName:}" failed. No retries permitted until 2026-10-30 21:53:04.119883867 +0000 UTC m=+34.227249609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zgp75" (UniqueName: "kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75") pod "network-check-target-dxkrb" (UID: "c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:48.343221 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:48.343151 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:48.343331 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:48.343282 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ztlk7" podUID="b6b30cd9-d376-4e9e-8f95-d4d2c504cd93" Oct 30 21:52:48.343365 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:48.343329 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:48.343424 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:48.343408 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5jhm" podUID="967b7974-ef9d-4eff-8265-879c05e6fc96" Oct 30 21:52:48.521106 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:48.521072 2580 generic.go:356] "Generic (PLEG): container finished" podID="cfb5127e-d35c-4d71-9565-b8044e41f2bc" containerID="71f918d5f6a42b5cfacf79802c2df2816bf23a433ebcf3b260d39012d80dc0e3" exitCode=0 Oct 30 21:52:48.521530 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:48.521119 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpw8h" event={"ID":"cfb5127e-d35c-4d71-9565-b8044e41f2bc","Type":"ContainerDied","Data":"71f918d5f6a42b5cfacf79802c2df2816bf23a433ebcf3b260d39012d80dc0e3"} Oct 30 21:52:49.342550 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:49.342520 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:49.342711 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:49.342604 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxkrb" podUID="c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b" Oct 30 21:52:49.527502 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:49.527471 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" event={"ID":"754f74c1-4a21-4497-bdb6-9b8b1e97842a","Type":"ContainerStarted","Data":"232ac7d3809558f7915e456f9ad6346809ce2f4b5e2738ba0347c0defd5c5575"} Oct 30 21:52:49.530958 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:49.530934 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vpw8h" event={"ID":"cfb5127e-d35c-4d71-9565-b8044e41f2bc","Type":"ContainerStarted","Data":"d12e99fd1af487bad0dcd6924c490afa646c0e6fab657fd7a05ae1a5859ca25a"} Oct 30 21:52:49.557878 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:49.557827 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vpw8h" podStartSLOduration=8.947465438 podStartE2EDuration="19.557815716s" totalImagesPullingTime="10.610350278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:49.55771239 +0000 UTC m=+19.665078142" watchObservedRunningTime="2026-10-30 21:52:49.557815716 +0000 UTC m=+19.665181466" Oct 30 21:52:50.343898 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:50.343298 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:50.343898 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:50.343649 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:50.343898 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:50.343773 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5jhm" podUID="967b7974-ef9d-4eff-8265-879c05e6fc96" Oct 30 21:52:50.344181 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:50.343920 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ztlk7" podUID="b6b30cd9-d376-4e9e-8f95-d4d2c504cd93" Oct 30 21:52:51.342581 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:51.342552 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:51.343023 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:51.342635 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxkrb" podUID="c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b" Oct 30 21:52:52.343518 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:52.343340 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:52.344263 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:52.343397 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:52.344263 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:52.343579 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5jhm" podUID="967b7974-ef9d-4eff-8265-879c05e6fc96" Oct 30 21:52:52.344263 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:52.343651 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ztlk7" podUID="b6b30cd9-d376-4e9e-8f95-d4d2c504cd93" Oct 30 21:52:52.539268 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:52.539235 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" event={"ID":"754f74c1-4a21-4497-bdb6-9b8b1e97842a","Type":"ContainerStarted","Data":"4e24e7c9df12441820dc8b4a324e733239f6c5ef65e7d273bbd8d6c6126c2d04"} Oct 30 21:52:52.539582 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:52.539565 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:52.539698 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:52.539636 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:52.554884 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:52.554852 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:52.554992 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:52.554952 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:52:52.573462 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:52.573425 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" podStartSLOduration=8.073868146 podStartE2EDuration="22.573415749s" totalImagesPullingTime="14.499547603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:52.572715298 +0000 UTC m=+22.680081049" watchObservedRunningTime="2026-10-30 21:52:52.573415749 +0000 UTC m=+22.680781499" Oct 30 21:52:53.285390 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:53.285357 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dxkrb"] Oct 30 21:52:53.285550 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:53.285537 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:53.285655 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:53.285637 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxkrb" podUID="c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b" Oct 30 21:52:53.287836 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:53.287814 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s5jhm"] Oct 30 21:52:53.287943 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:53.287919 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:53.288006 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:53.287991 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5jhm" podUID="967b7974-ef9d-4eff-8265-879c05e6fc96" Oct 30 21:52:53.290760 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:53.290740 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ztlk7"] Oct 30 21:52:53.290892 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:53.290879 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:53.290983 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:53.290963 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ztlk7" podUID="b6b30cd9-d376-4e9e-8f95-d4d2c504cd93" Oct 30 21:52:53.541566 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:53.541481 2580 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 21:52:54.543332 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:54.543306 2580 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 21:52:55.343344 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:55.343305 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:55.343527 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:55.343309 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:55.343527 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:55.343413 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5jhm" podUID="967b7974-ef9d-4eff-8265-879c05e6fc96" Oct 30 21:52:55.343527 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:55.343428 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:55.343527 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:55.343517 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ztlk7" podUID="b6b30cd9-d376-4e9e-8f95-d4d2c504cd93" Oct 30 21:52:55.343680 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:55.343577 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxkrb" podUID="c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b" Oct 30 21:52:57.343003 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:57.342971 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:57.343003 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:57.342996 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:57.343474 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:57.343061 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5jhm" podUID="967b7974-ef9d-4eff-8265-879c05e6fc96" Oct 30 21:52:57.343474 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:57.343121 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:57.343474 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:57.343220 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ztlk7" podUID="b6b30cd9-d376-4e9e-8f95-d4d2c504cd93" Oct 30 21:52:57.343474 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:57.343293 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxkrb" podUID="c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b" Oct 30 21:52:58.696162 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.696133 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeReady" Oct 30 21:52:58.696659 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.696278 2580 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 30 21:52:58.747434 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.747405 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-n2r6j"] Oct 30 21:52:58.749239 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.749224 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-n2r6j" Oct 30 21:52:58.752097 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.752067 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-zswrm"] Oct 30 21:52:58.755415 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.755394 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6c8767fbdc-sxmpb"] Oct 30 21:52:58.755527 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.755512 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-zswrm" Oct 30 21:52:58.757636 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.757085 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-bqtvv"] Oct 30 21:52:58.758257 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.758235 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:58.758439 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.758416 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp"] Oct 30 21:52:58.759948 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.759923 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-bqtvv" Oct 30 21:52:58.765801 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.765021 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-frqg6"] Oct 30 21:52:58.765801 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.765119 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:52:58.767004 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.766986 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr"] Oct 30 21:52:58.767124 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.767105 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:58.768456 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.768438 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-rsx79"] Oct 30 21:52:58.768649 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.768633 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:52:58.769625 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.769608 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Oct 30 21:52:58.769708 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.769609 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 30 21:52:58.769931 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.769912 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Oct 30 21:52:58.770080 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.770023 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Oct 30 21:52:58.770080 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.770074 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Oct 30 21:52:58.770197 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.770139 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b99f4cc75-7drms"] Oct 30 21:52:58.770248 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.770233 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rsx79" Oct 30 21:52:58.770422 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.770404 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Oct 30 21:52:58.770689 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.770661 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Oct 30 21:52:58.770769 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.770711 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 30 21:52:58.771090 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.771070 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8689j\"" Oct 30 21:52:58.771880 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.771849 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-4fs6t"] Oct 30 21:52:58.771949 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.771935 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.773258 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.773244 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6585488f54-nw2ht"] Oct 30 21:52:58.773369 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.773356 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:52:58.774690 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.774667 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl"] Oct 30 21:52:58.774815 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.774789 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.776305 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.776289 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-hn7m5"] Oct 30 21:52:58.776413 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.776397 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:52:58.778520 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.778485 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh"] Oct 30 21:52:58.778660 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.778650 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:52:58.780833 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.780790 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-l9ktm"] Oct 30 21:52:58.781137 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.781097 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:52:58.788561 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.788538 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-n2r6j"] Oct 30 21:52:58.790273 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.788579 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sq7zn"] Oct 30 21:52:58.790273 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.788654 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-l9ktm" Oct 30 21:52:58.791356 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.791338 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-bqtvv"] Oct 30 21:52:58.791500 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.791487 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-rsx79"] Oct 30 21:52:58.791624 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.791594 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-zswrm"] Oct 30 21:52:58.791770 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.791628 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr"] Oct 30 21:52:58.791770 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.791651 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp"] Oct 30 21:52:58.791770 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.791674 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-frqg6"] Oct 30 21:52:58.791770 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.791698 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-hn7m5"] Oct 30 21:52:58.791770 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.791719 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b99f4cc75-7drms"] Oct 30 21:52:58.791770 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.791738 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-l9ktm"] Oct 30 21:52:58.791770 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.791758 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6585488f54-nw2ht"] Oct 30 21:52:58.793872 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.791837 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sq7zn" Oct 30 21:52:58.793872 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.792537 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl"] Oct 30 21:52:58.793872 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.793677 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c8767fbdc-sxmpb"] Oct 30 21:52:58.794352 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.794330 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sgzrz"] Oct 30 21:52:58.797125 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.797091 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sgzrz" Oct 30 21:52:58.810281 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.810244 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sq7zn"] Oct 30 21:52:58.819704 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.819669 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh"] Oct 30 21:52:58.823979 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.823959 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sgzrz"] Oct 30 21:52:58.832296 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.832261 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-4fs6t"] Oct 30 21:52:58.870242 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.870221 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Oct 30 21:52:58.870341 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.870225 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:52:58.872735 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.872716 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 21:52:58.872824 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.872746 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Oct 30 21:52:58.892674 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.892649 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 21:52:58.892782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.892771 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-installation-pull-secrets\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.892843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.892799 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-bound-sa-token\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.892843 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.892816 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-4fs6t\" (UID: \"38da3026-ac7f-44af-aa6c-f16cf3082c9e\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:52:58.892986 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.892883 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4646859-cf39-4d6b-a2e2-f2795635390c-config\") pod \"service-ca-operator-544d749c8c-8xqzr\" (UID: \"a4646859-cf39-4d6b-a2e2-f2795635390c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:52:58.892986 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.892955 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.892986 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.892974 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:52:58.893132 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893005 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tskrq\" (UniqueName: \"kubernetes.io/projected/7f473fc1-7e45-4581-9426-009af0a1682b-kube-api-access-tskrq\") pod \"kas-connection-checker-685895c7c9-zswrm\" (UID: \"7f473fc1-7e45-4581-9426-009af0a1682b\") " pod="kube-system/kas-connection-checker-685895c7c9-zswrm" Oct 30 21:52:58.893132 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893040 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:58.893132 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893117 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-trusted-ca\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.893274 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893138 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 21:52:58.893274 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893145 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-bound-sa-token\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.893274 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893209 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9ln7\" (UniqueName: \"kubernetes.io/projected/3d901cac-9d8d-48f8-b1a6-61ae43d46721-kube-api-access-q9ln7\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:52:58.893274 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893256 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/38da3026-ac7f-44af-aa6c-f16cf3082c9e-nginx-conf\") pod \"networking-console-plugin-86c478bb88-4fs6t\" (UID: \"38da3026-ac7f-44af-aa6c-f16cf3082c9e\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:52:58.893507 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893293 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cfcee7d-4a08-441e-874b-5486b381d0f2-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:58.893507 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893346 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cfcee7d-4a08-441e-874b-5486b381d0f2-service-ca-bundle\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:58.893507 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893379 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 21:52:58.893507 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893407 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Oct 30 21:52:58.893507 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893420 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 21:52:58.893507 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893429 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4646859-cf39-4d6b-a2e2-f2795635390c-serving-cert\") pod \"service-ca-operator-544d749c8c-8xqzr\" (UID: \"a4646859-cf39-4d6b-a2e2-f2795635390c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:52:58.893507 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893489 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pps4d\" (UniqueName: \"kubernetes.io/projected/8328c2d0-1c49-4619-8ccc-4a238ce29121-kube-api-access-pps4d\") pod \"kas-connection-checker-685895c7c9-bqtvv\" (UID: \"8328c2d0-1c49-4619-8ccc-4a238ce29121\") " pod="kube-system/kas-connection-checker-685895c7c9-bqtvv" Oct 30 21:52:58.893507 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893502 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-installation-pull-secrets\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893536 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893538 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c068922-cad3-472a-a20a-890955ecb231-serving-cert\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893569 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893600 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gzr6\" (UniqueName: \"kubernetes.io/projected/c41902e8-bf12-4ecc-a6e1-b87582b20f86-kube-api-access-4gzr6\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893634 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6pqj\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-kube-api-access-k6pqj\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893649 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88107d0e-6b47-4320-8647-2a597f418bf4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl\" (UID: \"88107d0e-6b47-4320-8647-2a597f418bf4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893703 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893712 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893720 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893718 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893732 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-984vh\" (UniqueName: \"kubernetes.io/projected/6f371722-dc8f-48eb-8f8c-28f394ef4360-kube-api-access-984vh\") pod \"volume-data-source-validator-58c9f5f46d-l9ktm\" (UID: \"6f371722-dc8f-48eb-8f8c-28f394ef4360\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-l9ktm" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893744 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893756 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-registry-certificates\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893772 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9cqn\" (UniqueName: \"kubernetes.io/projected/181f4022-4f53-4e23-8424-01f6b5e06ec6-kube-api-access-x9cqn\") pod \"ingress-canary-sgzrz\" (UID: \"181f4022-4f53-4e23-8424-01f6b5e06ec6\") " pod="openshift-ingress-canary/ingress-canary-sgzrz" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893810 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4846560b-5370-4fa1-8d36-43dfc4011191-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893830 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:52:58.893939 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893847 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-certificates\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.894782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893895 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cfcee7d-4a08-441e-874b-5486b381d0f2-tmp\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:58.894782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893949 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c068922-cad3-472a-a20a-890955ecb231-config\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:52:58.894782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.893986 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z22xr\" (UniqueName: \"kubernetes.io/projected/3444842c-2f38-409f-ba87-e21af956df52-kube-api-access-z22xr\") pod \"network-check-source-6f78d59f99-rsx79\" (UID: \"3444842c-2f38-409f-ba87-e21af956df52\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rsx79" Oct 30 21:52:58.894782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894014 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcwnh\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-kube-api-access-vcwnh\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.894782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894061 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvj8c\" (UniqueName: \"kubernetes.io/projected/7c068922-cad3-472a-a20a-890955ecb231-kube-api-access-vvj8c\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:52:58.894782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894095 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-image-registry-private-configuration\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.894782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894112 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/181f4022-4f53-4e23-8424-01f6b5e06ec6-cert\") pod \"ingress-canary-sgzrz\" (UID: \"181f4022-4f53-4e23-8424-01f6b5e06ec6\") " pod="openshift-ingress-canary/ingress-canary-sgzrz" Oct 30 21:52:58.894782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894127 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr8d5\" (UniqueName: \"kubernetes.io/projected/88107d0e-6b47-4320-8647-2a597f418bf4-kube-api-access-gr8d5\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl\" (UID: \"88107d0e-6b47-4320-8647-2a597f418bf4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:52:58.894782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894179 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcnlq\" (UniqueName: \"kubernetes.io/projected/c7c738de-1f94-4fb0-a389-84512dcb22b9-kube-api-access-wcnlq\") pod \"kas-connection-checker-685895c7c9-n2r6j\" (UID: \"c7c738de-1f94-4fb0-a389-84512dcb22b9\") " pod="kube-system/kas-connection-checker-685895c7c9-n2r6j" Oct 30 21:52:58.894782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894228 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d901cac-9d8d-48f8-b1a6-61ae43d46721-config-volume\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:52:58.894782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894258 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:52:58.894782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894310 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-stats-auth\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:58.894782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894337 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-image-registry-private-configuration\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.894782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894366 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c068922-cad3-472a-a20a-890955ecb231-trusted-ca\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:52:58.894782 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894413 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894439 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88107d0e-6b47-4320-8647-2a597f418bf4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl\" (UID: \"88107d0e-6b47-4320-8647-2a597f418bf4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894455 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894477 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cfcee7d-4a08-441e-874b-5486b381d0f2-serving-cert\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894488 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894502 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5g2m\" (UniqueName: \"kubernetes.io/projected/4846560b-5370-4fa1-8d36-43dfc4011191-kube-api-access-w5g2m\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894591 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lx28\" (UniqueName: \"kubernetes.io/projected/cc3ee40a-be4e-476f-91ff-a0cd164812fc-kube-api-access-2lx28\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894616 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-trusted-ca\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894641 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3cfcee7d-4a08-441e-874b-5486b381d0f2-snapshots\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894664 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d901cac-9d8d-48f8-b1a6-61ae43d46721-tmp-dir\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894737 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd77j\" (UniqueName: \"kubernetes.io/projected/a4646859-cf39-4d6b-a2e2-f2795635390c-kube-api-access-bd77j\") pod \"service-ca-operator-544d749c8c-8xqzr\" (UID: \"a4646859-cf39-4d6b-a2e2-f2795635390c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894789 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-ca-trust-extracted\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894881 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894929 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894934 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb8pz\" (UniqueName: \"kubernetes.io/projected/3cfcee7d-4a08-441e-874b-5486b381d0f2-kube-api-access-bb8pz\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894964 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/012b8527-ec34-4639-b76c-5f941b31d02d-ca-trust-extracted\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.894993 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.895001 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 21:52:58.895377 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.895002 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-default-certificate\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:58.895977 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.895028 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:52:58.895977 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.895132 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Oct 30 21:52:58.895977 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.895147 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:52:58.895977 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.895156 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Oct 30 21:52:58.895977 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.895171 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 21:52:58.895977 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.895919 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 21:52:58.895977 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.895936 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 21:52:58.895977 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.895958 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 21:52:58.895977 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.895975 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 21:52:58.896490 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.896107 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Oct 30 21:52:58.896490 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.896216 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 21:52:58.896490 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.896225 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Oct 30 21:52:58.896490 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.896355 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Oct 30 21:52:58.896490 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.896396 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Oct 30 21:52:58.896490 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.896403 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Oct 30 21:52:58.897334 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.897321 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4qnnv\"" Oct 30 21:52:58.897438 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.897424 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-qzflj\"" Oct 30 21:52:58.897641 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.897627 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zxtr5\"" Oct 30 21:52:58.897678 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.897668 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8glf6\"" Oct 30 21:52:58.898581 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.898568 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bcrlz\"" Oct 30 21:52:58.898627 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.898586 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-sr8tx\"" Oct 30 21:52:58.898627 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.898585 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rccpg\"" Oct 30 21:52:58.898627 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.898600 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l9jfx\"" Oct 30 21:52:58.898914 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.898903 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 30 21:52:58.900102 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.900089 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mqkw9\"" Oct 30 21:52:58.900275 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.900260 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hhtlp\"" Oct 30 21:52:58.900341 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.900288 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dtfm6\"" Oct 30 21:52:58.900341 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.900295 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-chfpx\"" Oct 30 21:52:58.903503 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.903483 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Oct 30 21:52:58.909197 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.909161 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 21:52:58.910370 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.910348 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Oct 30 21:52:58.910370 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.910363 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 30 21:52:58.995453 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.995418 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3cfcee7d-4a08-441e-874b-5486b381d0f2-snapshots\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:58.995453 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.995456 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d901cac-9d8d-48f8-b1a6-61ae43d46721-tmp-dir\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:52:58.995847 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.995483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd77j\" (UniqueName: \"kubernetes.io/projected/a4646859-cf39-4d6b-a2e2-f2795635390c-kube-api-access-bd77j\") pod \"service-ca-operator-544d749c8c-8xqzr\" (UID: \"a4646859-cf39-4d6b-a2e2-f2795635390c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:52:58.995847 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.995505 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-ca-trust-extracted\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.995847 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.995531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb8pz\" (UniqueName: \"kubernetes.io/projected/3cfcee7d-4a08-441e-874b-5486b381d0f2-kube-api-access-bb8pz\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:58.995847 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.995553 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/012b8527-ec34-4639-b76c-5f941b31d02d-ca-trust-extracted\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.995847 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.995827 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d901cac-9d8d-48f8-b1a6-61ae43d46721-tmp-dir\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.995915 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-default-certificate\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.995954 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/012b8527-ec34-4639-b76c-5f941b31d02d-ca-trust-extracted\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996025 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-ca-trust-extracted\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996076 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996116 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-installation-pull-secrets\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996140 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-bound-sa-token\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996164 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-4fs6t\" (UID: \"38da3026-ac7f-44af-aa6c-f16cf3082c9e\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4646859-cf39-4d6b-a2e2-f2795635390c-config\") pod \"service-ca-operator-544d749c8c-8xqzr\" (UID: \"a4646859-cf39-4d6b-a2e2-f2795635390c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tskrq\" (UniqueName: \"kubernetes.io/projected/7f473fc1-7e45-4581-9426-009af0a1682b-kube-api-access-tskrq\") pod \"kas-connection-checker-685895c7c9-zswrm\" (UID: \"7f473fc1-7e45-4581-9426-009af0a1682b\") " pod="kube-system/kas-connection-checker-685895c7c9-zswrm" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996260 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-trusted-ca\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996324 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-bound-sa-token\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9ln7\" (UniqueName: \"kubernetes.io/projected/3d901cac-9d8d-48f8-b1a6-61ae43d46721-kube-api-access-q9ln7\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996367 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/38da3026-ac7f-44af-aa6c-f16cf3082c9e-nginx-conf\") pod \"networking-console-plugin-86c478bb88-4fs6t\" (UID: \"38da3026-ac7f-44af-aa6c-f16cf3082c9e\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:52:58.996940 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996389 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3cfcee7d-4a08-441e-874b-5486b381d0f2-snapshots\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:58.997651 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cfcee7d-4a08-441e-874b-5486b381d0f2-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:58.997651 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996444 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cfcee7d-4a08-441e-874b-5486b381d0f2-service-ca-bundle\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:58.997651 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996474 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4646859-cf39-4d6b-a2e2-f2795635390c-serving-cert\") pod \"service-ca-operator-544d749c8c-8xqzr\" (UID: \"a4646859-cf39-4d6b-a2e2-f2795635390c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:52:58.997651 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996506 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pps4d\" (UniqueName: \"kubernetes.io/projected/8328c2d0-1c49-4619-8ccc-4a238ce29121-kube-api-access-pps4d\") pod \"kas-connection-checker-685895c7c9-bqtvv\" (UID: \"8328c2d0-1c49-4619-8ccc-4a238ce29121\") " pod="kube-system/kas-connection-checker-685895c7c9-bqtvv" Oct 30 21:52:58.997651 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996530 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-installation-pull-secrets\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.997651 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c068922-cad3-472a-a20a-890955ecb231-serving-cert\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:52:58.997651 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:52:58.997651 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996622 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzr6\" (UniqueName: \"kubernetes.io/projected/c41902e8-bf12-4ecc-a6e1-b87582b20f86-kube-api-access-4gzr6\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:52:58.997651 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996646 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6pqj\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-kube-api-access-k6pqj\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.997651 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996667 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88107d0e-6b47-4320-8647-2a597f418bf4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl\" (UID: \"88107d0e-6b47-4320-8647-2a597f418bf4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:52:58.997651 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996696 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.997651 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996716 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-984vh\" (UniqueName: \"kubernetes.io/projected/6f371722-dc8f-48eb-8f8c-28f394ef4360-kube-api-access-984vh\") pod \"volume-data-source-validator-58c9f5f46d-l9ktm\" (UID: \"6f371722-dc8f-48eb-8f8c-28f394ef4360\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-l9ktm" Oct 30 21:52:58.997651 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996739 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-registry-certificates\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.997651 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996759 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9cqn\" (UniqueName: \"kubernetes.io/projected/181f4022-4f53-4e23-8424-01f6b5e06ec6-kube-api-access-x9cqn\") pod \"ingress-canary-sgzrz\" (UID: \"181f4022-4f53-4e23-8424-01f6b5e06ec6\") " pod="openshift-ingress-canary/ingress-canary-sgzrz" Oct 30 21:52:58.997651 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996780 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4846560b-5370-4fa1-8d36-43dfc4011191-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996825 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-certificates\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996844 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cfcee7d-4a08-441e-874b-5486b381d0f2-tmp\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996882 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c068922-cad3-472a-a20a-890955ecb231-config\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996910 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z22xr\" (UniqueName: \"kubernetes.io/projected/3444842c-2f38-409f-ba87-e21af956df52-kube-api-access-z22xr\") pod \"network-check-source-6f78d59f99-rsx79\" (UID: \"3444842c-2f38-409f-ba87-e21af956df52\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rsx79" Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996931 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcwnh\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-kube-api-access-vcwnh\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.996964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvj8c\" (UniqueName: \"kubernetes.io/projected/7c068922-cad3-472a-a20a-890955ecb231-kube-api-access-vvj8c\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.997007 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-image-registry-private-configuration\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.997267 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cfcee7d-4a08-441e-874b-5486b381d0f2-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:58.997538 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:58.997592 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs podName:cc3ee40a-be4e-476f-91ff-a0cd164812fc nodeName:}" failed. No retries permitted until 2026-10-30 21:52:59.497575953 +0000 UTC m=+29.604941687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs") pod "router-default-6c8767fbdc-sxmpb" (UID: "cc3ee40a-be4e-476f-91ff-a0cd164812fc") : secret "router-metrics-certs-default" not found Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.997731 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/181f4022-4f53-4e23-8424-01f6b5e06ec6-cert\") pod \"ingress-canary-sgzrz\" (UID: \"181f4022-4f53-4e23-8424-01f6b5e06ec6\") " pod="openshift-ingress-canary/ingress-canary-sgzrz" Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.997765 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr8d5\" (UniqueName: \"kubernetes.io/projected/88107d0e-6b47-4320-8647-2a597f418bf4-kube-api-access-gr8d5\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl\" (UID: \"88107d0e-6b47-4320-8647-2a597f418bf4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.997800 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnlq\" (UniqueName: \"kubernetes.io/projected/c7c738de-1f94-4fb0-a389-84512dcb22b9-kube-api-access-wcnlq\") pod \"kas-connection-checker-685895c7c9-n2r6j\" (UID: \"c7c738de-1f94-4fb0-a389-84512dcb22b9\") " pod="kube-system/kas-connection-checker-685895c7c9-n2r6j" Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.997832 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d901cac-9d8d-48f8-b1a6-61ae43d46721-config-volume\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:52:58.998135 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:58.997878 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 21:52:58.998902 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:58.997938 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert podName:38da3026-ac7f-44af-aa6c-f16cf3082c9e nodeName:}" failed. No retries permitted until 2026-10-30 21:52:59.497919945 +0000 UTC m=+29.605285685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-4fs6t" (UID: "38da3026-ac7f-44af-aa6c-f16cf3082c9e") : secret "networking-console-plugin-cert" not found Oct 30 21:52:58.998902 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:58.997950 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 21:52:58.998902 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:58.997993 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls podName:c41902e8-bf12-4ecc-a6e1-b87582b20f86 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:59.49797972 +0000 UTC m=+29.605345472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-kgnrh" (UID: "c41902e8-bf12-4ecc-a6e1-b87582b20f86") : secret "samples-operator-tls" not found Oct 30 21:52:58.998902 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.998131 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cfcee7d-4a08-441e-874b-5486b381d0f2-service-ca-bundle\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:58.998902 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:58.998303 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 21:52:58.998902 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:58.998346 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls podName:3d901cac-9d8d-48f8-b1a6-61ae43d46721 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:59.498333341 +0000 UTC m=+29.605699087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls") pod "dns-default-sq7zn" (UID: "3d901cac-9d8d-48f8-b1a6-61ae43d46721") : secret "dns-default-metrics-tls" not found Oct 30 21:52:58.998902 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.998456 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-registry-certificates\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:58.998902 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.998522 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4646859-cf39-4d6b-a2e2-f2795635390c-config\") pod \"service-ca-operator-544d749c8c-8xqzr\" (UID: \"a4646859-cf39-4d6b-a2e2-f2795635390c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:52:58.998902 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.998570 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:52:58.998902 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:58.998774 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 21:52:58.998902 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.998802 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-certificates\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:58.998902 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:58.998839 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls podName:4846560b-5370-4fa1-8d36-43dfc4011191 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:59.498824313 +0000 UTC m=+29.606190063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-d6jlp" (UID: "4846560b-5370-4fa1-8d36-43dfc4011191") : secret "cluster-monitoring-operator-tls" not found Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.998947 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4846560b-5370-4fa1-8d36-43dfc4011191-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.999058 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cfcee7d-4a08-441e-874b-5486b381d0f2-tmp\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:58.999125 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:58.999140 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6585488f54-nw2ht: secret "image-registry-tls" not found Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:58.999187 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls podName:012b8527-ec34-4639-b76c-5f941b31d02d nodeName:}" failed. No retries permitted until 2026-10-30 21:52:59.49917415 +0000 UTC m=+29.606539891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls") pod "image-registry-6585488f54-nw2ht" (UID: "012b8527-ec34-4639-b76c-5f941b31d02d") : secret "image-registry-tls" not found Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.997877 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.999227 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-stats-auth\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.999256 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-image-registry-private-configuration\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.999284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c068922-cad3-472a-a20a-890955ecb231-trusted-ca\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.999313 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.999337 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88107d0e-6b47-4320-8647-2a597f418bf4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl\" (UID: \"88107d0e-6b47-4320-8647-2a597f418bf4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.999361 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cfcee7d-4a08-441e-874b-5486b381d0f2-serving-cert\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.999387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5g2m\" (UniqueName: \"kubernetes.io/projected/4846560b-5370-4fa1-8d36-43dfc4011191-kube-api-access-w5g2m\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.999434 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lx28\" (UniqueName: \"kubernetes.io/projected/cc3ee40a-be4e-476f-91ff-a0cd164812fc-kube-api-access-2lx28\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.999458 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-trusted-ca\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:59.000092 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.999746 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c068922-cad3-472a-a20a-890955ecb231-config\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:52:59.000886 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:58.999943 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/38da3026-ac7f-44af-aa6c-f16cf3082c9e-nginx-conf\") pod \"networking-console-plugin-86c478bb88-4fs6t\" (UID: \"38da3026-ac7f-44af-aa6c-f16cf3082c9e\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:52:59.000886 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.000007 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 21:52:59.000886 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.000025 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b99f4cc75-7drms: secret "image-registry-tls" not found Oct 30 21:52:59.000886 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.000083 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls podName:9ca45dcf-d2cd-4797-be23-47d5ac33b57b nodeName:}" failed. No retries permitted until 2026-10-30 21:52:59.500067549 +0000 UTC m=+29.607433320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls") pod "image-registry-7b99f4cc75-7drms" (UID: "9ca45dcf-d2cd-4797-be23-47d5ac33b57b") : secret "image-registry-tls" not found Oct 30 21:52:59.000886 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.000338 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-trusted-ca\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:59.000886 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.000590 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-trusted-ca\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:59.000886 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.000632 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88107d0e-6b47-4320-8647-2a597f418bf4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl\" (UID: \"88107d0e-6b47-4320-8647-2a597f418bf4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:52:59.001218 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.001178 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d901cac-9d8d-48f8-b1a6-61ae43d46721-config-volume\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:52:59.001617 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.001357 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-default-certificate\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:59.001617 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.001492 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c068922-cad3-472a-a20a-890955ecb231-trusted-ca\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:52:59.001795 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.001646 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle podName:cc3ee40a-be4e-476f-91ff-a0cd164812fc nodeName:}" failed. No retries permitted until 2026-10-30 21:52:59.501585783 +0000 UTC m=+29.608951533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle") pod "router-default-6c8767fbdc-sxmpb" (UID: "cc3ee40a-be4e-476f-91ff-a0cd164812fc") : configmap references non-existent config key: service-ca.crt Oct 30 21:52:59.002533 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.002512 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-image-registry-private-configuration\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:59.003140 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.003121 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88107d0e-6b47-4320-8647-2a597f418bf4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl\" (UID: \"88107d0e-6b47-4320-8647-2a597f418bf4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:52:59.004011 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.003966 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-image-registry-private-configuration\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:59.004089 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.004035 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c068922-cad3-472a-a20a-890955ecb231-serving-cert\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:52:59.004155 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.004134 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4646859-cf39-4d6b-a2e2-f2795635390c-serving-cert\") pod \"service-ca-operator-544d749c8c-8xqzr\" (UID: \"a4646859-cf39-4d6b-a2e2-f2795635390c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:52:59.004298 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.004281 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-stats-auth\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:59.004352 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.004321 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/181f4022-4f53-4e23-8424-01f6b5e06ec6-cert\") pod \"ingress-canary-sgzrz\" (UID: \"181f4022-4f53-4e23-8424-01f6b5e06ec6\") " pod="openshift-ingress-canary/ingress-canary-sgzrz" Oct 30 21:52:59.004518 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.004501 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-installation-pull-secrets\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:59.005532 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.005513 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cfcee7d-4a08-441e-874b-5486b381d0f2-serving-cert\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:59.005768 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.005748 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-installation-pull-secrets\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:59.007718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.007701 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb8pz\" (UniqueName: \"kubernetes.io/projected/3cfcee7d-4a08-441e-874b-5486b381d0f2-kube-api-access-bb8pz\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:59.008949 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.008932 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-984vh\" (UniqueName: \"kubernetes.io/projected/6f371722-dc8f-48eb-8f8c-28f394ef4360-kube-api-access-984vh\") pod \"volume-data-source-validator-58c9f5f46d-l9ktm\" (UID: \"6f371722-dc8f-48eb-8f8c-28f394ef4360\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-l9ktm" Oct 30 21:52:59.009249 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.009233 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tskrq\" (UniqueName: \"kubernetes.io/projected/7f473fc1-7e45-4581-9426-009af0a1682b-kube-api-access-tskrq\") pod \"kas-connection-checker-685895c7c9-zswrm\" (UID: \"7f473fc1-7e45-4581-9426-009af0a1682b\") " pod="kube-system/kas-connection-checker-685895c7c9-zswrm" Oct 30 21:52:59.011373 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.011349 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd77j\" (UniqueName: \"kubernetes.io/projected/a4646859-cf39-4d6b-a2e2-f2795635390c-kube-api-access-bd77j\") pod \"service-ca-operator-544d749c8c-8xqzr\" (UID: \"a4646859-cf39-4d6b-a2e2-f2795635390c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:52:59.011762 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.011741 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9cqn\" (UniqueName: \"kubernetes.io/projected/181f4022-4f53-4e23-8424-01f6b5e06ec6-kube-api-access-x9cqn\") pod \"ingress-canary-sgzrz\" (UID: \"181f4022-4f53-4e23-8424-01f6b5e06ec6\") " pod="openshift-ingress-canary/ingress-canary-sgzrz" Oct 30 21:52:59.014157 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.013680 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcnlq\" (UniqueName: \"kubernetes.io/projected/c7c738de-1f94-4fb0-a389-84512dcb22b9-kube-api-access-wcnlq\") pod \"kas-connection-checker-685895c7c9-n2r6j\" (UID: \"c7c738de-1f94-4fb0-a389-84512dcb22b9\") " pod="kube-system/kas-connection-checker-685895c7c9-n2r6j" Oct 30 21:52:59.014157 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.013991 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pps4d\" (UniqueName: \"kubernetes.io/projected/8328c2d0-1c49-4619-8ccc-4a238ce29121-kube-api-access-pps4d\") pod \"kas-connection-checker-685895c7c9-bqtvv\" (UID: \"8328c2d0-1c49-4619-8ccc-4a238ce29121\") " pod="kube-system/kas-connection-checker-685895c7c9-bqtvv" Oct 30 21:52:59.014157 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.014072 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-bound-sa-token\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:59.014157 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.014115 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9ln7\" (UniqueName: \"kubernetes.io/projected/3d901cac-9d8d-48f8-b1a6-61ae43d46721-kube-api-access-q9ln7\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:52:59.014400 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.014217 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z22xr\" (UniqueName: \"kubernetes.io/projected/3444842c-2f38-409f-ba87-e21af956df52-kube-api-access-z22xr\") pod \"network-check-source-6f78d59f99-rsx79\" (UID: \"3444842c-2f38-409f-ba87-e21af956df52\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rsx79" Oct 30 21:52:59.014496 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.014479 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvj8c\" (UniqueName: \"kubernetes.io/projected/7c068922-cad3-472a-a20a-890955ecb231-kube-api-access-vvj8c\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:52:59.015717 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.015644 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-bound-sa-token\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:59.015909 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.015892 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6pqj\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-kube-api-access-k6pqj\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:59.017357 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.017337 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gzr6\" (UniqueName: \"kubernetes.io/projected/c41902e8-bf12-4ecc-a6e1-b87582b20f86-kube-api-access-4gzr6\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:52:59.019030 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.018997 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5g2m\" (UniqueName: \"kubernetes.io/projected/4846560b-5370-4fa1-8d36-43dfc4011191-kube-api-access-w5g2m\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:52:59.019403 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.019385 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lx28\" (UniqueName: \"kubernetes.io/projected/cc3ee40a-be4e-476f-91ff-a0cd164812fc-kube-api-access-2lx28\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:59.019476 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.019391 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr8d5\" (UniqueName: \"kubernetes.io/projected/88107d0e-6b47-4320-8647-2a597f418bf4-kube-api-access-gr8d5\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl\" (UID: \"88107d0e-6b47-4320-8647-2a597f418bf4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:52:59.027131 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.026984 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcwnh\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-kube-api-access-vcwnh\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:59.044304 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.044279 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:52:59.067349 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.067328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-n2r6j" Oct 30 21:52:59.073920 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.073903 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-zswrm" Oct 30 21:52:59.102724 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.102652 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-bqtvv" Oct 30 21:52:59.120880 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.120837 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:52:59.129965 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.129719 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:52:59.139451 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.139256 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rsx79" Oct 30 21:52:59.160368 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.160339 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:52:59.166332 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.166151 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:52:59.172563 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.172547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-l9ktm" Oct 30 21:52:59.184270 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.184044 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sgzrz" Oct 30 21:52:59.216025 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.214029 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:52:59.343346 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.343322 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:52:59.343458 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.343412 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:52:59.343531 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.343516 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:52:59.347930 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.347909 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 21:52:59.348040 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.347998 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-lttxg\"" Oct 30 21:52:59.348040 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.348005 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 21:52:59.348040 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.348009 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-bwmbw\"" Oct 30 21:52:59.348160 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.348092 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lpdnh\"" Oct 30 21:52:59.358777 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.358759 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-n2r6j"] Oct 30 21:52:59.361074 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.361057 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-zswrm"] Oct 30 21:52:59.362703 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:59.362685 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c738de_1f94_4fb0_a389_84512dcb22b9.slice/crio-6fa054a325b204e164a5e95c241ad49d48bad65ad4a437b14a2466a6819a2dff WatchSource:0}: Error finding container 6fa054a325b204e164a5e95c241ad49d48bad65ad4a437b14a2466a6819a2dff: Status 404 returned error can't find the container with id 6fa054a325b204e164a5e95c241ad49d48bad65ad4a437b14a2466a6819a2dff Oct 30 21:52:59.363112 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:59.363093 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f473fc1_7e45_4581_9426_009af0a1682b.slice/crio-4f1962aba89c60bbaaa40d51984227be2d7bcd018f94d2232a5f4dad4ad4aed4 WatchSource:0}: Error finding container 4f1962aba89c60bbaaa40d51984227be2d7bcd018f94d2232a5f4dad4ad4aed4: Status 404 returned error can't find the container with id 4f1962aba89c60bbaaa40d51984227be2d7bcd018f94d2232a5f4dad4ad4aed4 Oct 30 21:52:59.401213 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.401189 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-bqtvv"] Oct 30 21:52:59.437776 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.437673 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr"] Oct 30 21:52:59.441527 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:59.441491 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4646859_cf39_4d6b_a2e2_f2795635390c.slice/crio-99ad65df73e8ab151bd1ae509436872b6172b7d85a2f99c8999471bd8ebcf325 WatchSource:0}: Error finding container 99ad65df73e8ab151bd1ae509436872b6172b7d85a2f99c8999471bd8ebcf325: Status 404 returned error can't find the container with id 99ad65df73e8ab151bd1ae509436872b6172b7d85a2f99c8999471bd8ebcf325 Oct 30 21:52:59.445462 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.444899 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-rsx79"] Oct 30 21:52:59.451574 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:59.451402 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3444842c_2f38_409f_ba87_e21af956df52.slice/crio-9b42edc552da2d58e4dbec3399315ee170c341c813d4b0eb68817188ace05c45 WatchSource:0}: Error finding container 9b42edc552da2d58e4dbec3399315ee170c341c813d4b0eb68817188ace05c45: Status 404 returned error can't find the container with id 9b42edc552da2d58e4dbec3399315ee170c341c813d4b0eb68817188ace05c45 Oct 30 21:52:59.490480 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.490437 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-frqg6"] Oct 30 21:52:59.491932 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:59.491909 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cfcee7d_4a08_441e_874b_5486b381d0f2.slice/crio-f106cd5ffedf78915300e63a93f390a641a0dc289f673bf9730811dd00b89bce WatchSource:0}: Error finding container f106cd5ffedf78915300e63a93f390a641a0dc289f673bf9730811dd00b89bce: Status 404 returned error can't find the container with id f106cd5ffedf78915300e63a93f390a641a0dc289f673bf9730811dd00b89bce Oct 30 21:52:59.494203 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.494184 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-hn7m5"] Oct 30 21:52:59.499823 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:59.499663 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c068922_cad3_472a_a20a_890955ecb231.slice/crio-b89797fb1466c0ee0622a78b38151e3b12fdfa98edb0823a9045d8d03d3e1169 WatchSource:0}: Error finding container b89797fb1466c0ee0622a78b38151e3b12fdfa98edb0823a9045d8d03d3e1169: Status 404 returned error can't find the container with id b89797fb1466c0ee0622a78b38151e3b12fdfa98edb0823a9045d8d03d3e1169 Oct 30 21:52:59.506599 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.506573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:52:59.506718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.506670 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:52:59.506718 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.506709 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:59.506811 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.506789 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-4fs6t\" (UID: \"38da3026-ac7f-44af-aa6c-f16cf3082c9e\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:52:59.506901 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.506826 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:52:59.506901 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.506853 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:52:59.507003 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.506928 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:52:59.507003 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.506966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:52:59.507104 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507089 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 21:52:59.507160 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507108 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b99f4cc75-7drms: secret "image-registry-tls" not found Oct 30 21:52:59.507160 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507153 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls podName:9ca45dcf-d2cd-4797-be23-47d5ac33b57b nodeName:}" failed. No retries permitted until 2026-10-30 21:53:00.507136946 +0000 UTC m=+30.614502678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls") pod "image-registry-7b99f4cc75-7drms" (UID: "9ca45dcf-d2cd-4797-be23-47d5ac33b57b") : secret "image-registry-tls" not found Oct 30 21:52:59.507366 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507349 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 21:52:59.507447 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507367 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle podName:cc3ee40a-be4e-476f-91ff-a0cd164812fc nodeName:}" failed. No retries permitted until 2026-10-30 21:53:00.507351759 +0000 UTC m=+30.614717491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle") pod "router-default-6c8767fbdc-sxmpb" (UID: "cc3ee40a-be4e-476f-91ff-a0cd164812fc") : configmap references non-existent config key: service-ca.crt Oct 30 21:52:59.507447 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507412 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert podName:38da3026-ac7f-44af-aa6c-f16cf3082c9e nodeName:}" failed. No retries permitted until 2026-10-30 21:53:00.50739452 +0000 UTC m=+30.614760256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-4fs6t" (UID: "38da3026-ac7f-44af-aa6c-f16cf3082c9e") : secret "networking-console-plugin-cert" not found Oct 30 21:52:59.507531 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507475 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 21:52:59.507531 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507508 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls podName:c41902e8-bf12-4ecc-a6e1-b87582b20f86 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:00.507497773 +0000 UTC m=+30.614863507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-kgnrh" (UID: "c41902e8-bf12-4ecc-a6e1-b87582b20f86") : secret "samples-operator-tls" not found Oct 30 21:52:59.507599 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507577 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 21:52:59.507630 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507610 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs podName:cc3ee40a-be4e-476f-91ff-a0cd164812fc nodeName:}" failed. No retries permitted until 2026-10-30 21:53:00.50759978 +0000 UTC m=+30.614965511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs") pod "router-default-6c8767fbdc-sxmpb" (UID: "cc3ee40a-be4e-476f-91ff-a0cd164812fc") : secret "router-metrics-certs-default" not found Oct 30 21:52:59.507667 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507637 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 21:52:59.507667 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507666 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls podName:4846560b-5370-4fa1-8d36-43dfc4011191 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:00.50765755 +0000 UTC m=+30.615023278 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-d6jlp" (UID: "4846560b-5370-4fa1-8d36-43dfc4011191") : secret "cluster-monitoring-operator-tls" not found Oct 30 21:52:59.507728 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507680 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 21:52:59.507728 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507691 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 21:52:59.507728 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507691 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6585488f54-nw2ht: secret "image-registry-tls" not found Oct 30 21:52:59.507728 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507710 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls podName:3d901cac-9d8d-48f8-b1a6-61ae43d46721 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:00.507704408 +0000 UTC m=+30.615070137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls") pod "dns-default-sq7zn" (UID: "3d901cac-9d8d-48f8-b1a6-61ae43d46721") : secret "dns-default-metrics-tls" not found Oct 30 21:52:59.507728 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:52:59.507725 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls podName:012b8527-ec34-4639-b76c-5f941b31d02d nodeName:}" failed. No retries permitted until 2026-10-30 21:53:00.507714772 +0000 UTC m=+30.615080501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls") pod "image-registry-6585488f54-nw2ht" (UID: "012b8527-ec34-4639-b76c-5f941b31d02d") : secret "image-registry-tls" not found Oct 30 21:52:59.524701 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.524679 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-l9ktm"] Oct 30 21:52:59.529816 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.527654 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl"] Oct 30 21:52:59.529816 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.528740 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sgzrz"] Oct 30 21:52:59.529816 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:59.529345 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f371722_dc8f_48eb_8f8c_28f394ef4360.slice/crio-641f8c09540ad835e92bc47bca6b3986d7f12a7de44f314ba47c7ecd3c8ffec0 WatchSource:0}: Error finding container 641f8c09540ad835e92bc47bca6b3986d7f12a7de44f314ba47c7ecd3c8ffec0: Status 404 returned error can't find the container with id 641f8c09540ad835e92bc47bca6b3986d7f12a7de44f314ba47c7ecd3c8ffec0 Oct 30 21:52:59.533224 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:59.533201 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod181f4022_4f53_4e23_8424_01f6b5e06ec6.slice/crio-b768c924fe8c63ff64c8c0a2bbfab7318b150e36a32df1d3e854514bc34ea901 WatchSource:0}: Error finding container b768c924fe8c63ff64c8c0a2bbfab7318b150e36a32df1d3e854514bc34ea901: Status 404 returned error can't find the container with id b768c924fe8c63ff64c8c0a2bbfab7318b150e36a32df1d3e854514bc34ea901 Oct 30 21:52:59.534006 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:52:59.533984 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88107d0e_6b47_4320_8647_2a597f418bf4.slice/crio-dea68d5e3936f78b0a9c72e98e3622718670f36cd81f20f2e6c5b8d393d69303 WatchSource:0}: Error finding container dea68d5e3936f78b0a9c72e98e3622718670f36cd81f20f2e6c5b8d393d69303: Status 404 returned error can't find the container with id dea68d5e3936f78b0a9c72e98e3622718670f36cd81f20f2e6c5b8d393d69303 Oct 30 21:52:59.553851 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.553828 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-l9ktm" event={"ID":"6f371722-dc8f-48eb-8f8c-28f394ef4360","Type":"ContainerStarted","Data":"641f8c09540ad835e92bc47bca6b3986d7f12a7de44f314ba47c7ecd3c8ffec0"} Oct 30 21:52:59.554934 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.554912 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rsx79" event={"ID":"3444842c-2f38-409f-ba87-e21af956df52","Type":"ContainerStarted","Data":"9b42edc552da2d58e4dbec3399315ee170c341c813d4b0eb68817188ace05c45"} Oct 30 21:52:59.555897 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.555878 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sgzrz" event={"ID":"181f4022-4f53-4e23-8424-01f6b5e06ec6","Type":"ContainerStarted","Data":"b768c924fe8c63ff64c8c0a2bbfab7318b150e36a32df1d3e854514bc34ea901"} Oct 30 21:52:59.556899 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.556876 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" event={"ID":"7c068922-cad3-472a-a20a-890955ecb231","Type":"ContainerStarted","Data":"b89797fb1466c0ee0622a78b38151e3b12fdfa98edb0823a9045d8d03d3e1169"} Oct 30 21:52:59.557865 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.557835 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" event={"ID":"88107d0e-6b47-4320-8647-2a597f418bf4","Type":"ContainerStarted","Data":"dea68d5e3936f78b0a9c72e98e3622718670f36cd81f20f2e6c5b8d393d69303"} Oct 30 21:52:59.558914 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.558889 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" event={"ID":"a4646859-cf39-4d6b-a2e2-f2795635390c","Type":"ContainerStarted","Data":"99ad65df73e8ab151bd1ae509436872b6172b7d85a2f99c8999471bd8ebcf325"} Oct 30 21:52:59.560670 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.560650 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-bqtvv" event={"ID":"8328c2d0-1c49-4619-8ccc-4a238ce29121","Type":"ContainerStarted","Data":"d4c0ec07ae6073ebb7aafec3cfc228e1f8e546ba75b3343bff8d5dbe43f2af6c"} Oct 30 21:52:59.560763 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.560683 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-bqtvv" event={"ID":"8328c2d0-1c49-4619-8ccc-4a238ce29121","Type":"ContainerStarted","Data":"31528da19706fb78f14c82ffd1636a2adc80c2bf42a4d83c7c0367c9018690b9"} Oct 30 21:52:59.562104 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.562081 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-n2r6j" event={"ID":"c7c738de-1f94-4fb0-a389-84512dcb22b9","Type":"ContainerStarted","Data":"03bcfa8b754dc1587bb3251551be1a44ccb120640b1fa8a02a04a1dfbcc21d2d"} Oct 30 21:52:59.562225 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.562118 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-n2r6j" event={"ID":"c7c738de-1f94-4fb0-a389-84512dcb22b9","Type":"ContainerStarted","Data":"6fa054a325b204e164a5e95c241ad49d48bad65ad4a437b14a2466a6819a2dff"} Oct 30 21:52:59.563233 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.563206 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-frqg6" event={"ID":"3cfcee7d-4a08-441e-874b-5486b381d0f2","Type":"ContainerStarted","Data":"f106cd5ffedf78915300e63a93f390a641a0dc289f673bf9730811dd00b89bce"} Oct 30 21:52:59.564494 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.564472 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-zswrm" event={"ID":"7f473fc1-7e45-4581-9426-009af0a1682b","Type":"ContainerStarted","Data":"d33dfac518ca55a18d2b01524a85bf55796a7556e6b1bd70a837967374cc5fcc"} Oct 30 21:52:59.564603 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.564511 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-zswrm" event={"ID":"7f473fc1-7e45-4581-9426-009af0a1682b","Type":"ContainerStarted","Data":"4f1962aba89c60bbaaa40d51984227be2d7bcd018f94d2232a5f4dad4ad4aed4"} Oct 30 21:52:59.579388 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.579348 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-bqtvv" podStartSLOduration=397.579337962 podStartE2EDuration="6m37.579337962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:59.578963544 +0000 UTC m=+29.686329295" watchObservedRunningTime="2026-10-30 21:52:59.579337962 +0000 UTC m=+29.686703712" Oct 30 21:52:59.598568 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.598528 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-n2r6j" podStartSLOduration=397.598518476 podStartE2EDuration="6m37.598518476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:59.598147719 +0000 UTC m=+29.705513472" watchObservedRunningTime="2026-10-30 21:52:59.598518476 +0000 UTC m=+29.705884224" Oct 30 21:52:59.616686 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:52:59.616588 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-zswrm" podStartSLOduration=397.616578785 podStartE2EDuration="6m37.616578785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:59.615874817 +0000 UTC m=+29.723240566" watchObservedRunningTime="2026-10-30 21:52:59.616578785 +0000 UTC m=+29.723944535" Oct 30 21:53:00.519317 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:00.517717 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:00.519317 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:00.517798 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-4fs6t\" (UID: \"38da3026-ac7f-44af-aa6c-f16cf3082c9e\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:53:00.519317 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:00.517830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:00.519317 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:00.517873 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:00.519317 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:00.517935 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:53:00.519317 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:00.517975 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:00.519317 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:00.518021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:00.519317 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:00.518081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:53:00.519317 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518217 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 21:53:00.519317 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518278 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls podName:c41902e8-bf12-4ecc-a6e1-b87582b20f86 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:02.518260342 +0000 UTC m=+32.625626085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-kgnrh" (UID: "c41902e8-bf12-4ecc-a6e1-b87582b20f86") : secret "samples-operator-tls" not found Oct 30 21:53:00.519317 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518362 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle podName:cc3ee40a-be4e-476f-91ff-a0cd164812fc nodeName:}" failed. No retries permitted until 2026-10-30 21:53:02.518350793 +0000 UTC m=+32.625716539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle") pod "router-default-6c8767fbdc-sxmpb" (UID: "cc3ee40a-be4e-476f-91ff-a0cd164812fc") : configmap references non-existent config key: service-ca.crt Oct 30 21:53:00.519317 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518422 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 21:53:00.519317 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518457 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert podName:38da3026-ac7f-44af-aa6c-f16cf3082c9e nodeName:}" failed. No retries permitted until 2026-10-30 21:53:02.518445761 +0000 UTC m=+32.625811503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-4fs6t" (UID: "38da3026-ac7f-44af-aa6c-f16cf3082c9e") : secret "networking-console-plugin-cert" not found Oct 30 21:53:00.519317 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518522 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 21:53:00.519317 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518534 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6585488f54-nw2ht: secret "image-registry-tls" not found Oct 30 21:53:00.520904 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518564 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls podName:012b8527-ec34-4639-b76c-5f941b31d02d nodeName:}" failed. No retries permitted until 2026-10-30 21:53:02.518554428 +0000 UTC m=+32.625920172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls") pod "image-registry-6585488f54-nw2ht" (UID: "012b8527-ec34-4639-b76c-5f941b31d02d") : secret "image-registry-tls" not found Oct 30 21:53:00.520904 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518629 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 21:53:00.520904 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518655 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs podName:cc3ee40a-be4e-476f-91ff-a0cd164812fc nodeName:}" failed. No retries permitted until 2026-10-30 21:53:02.518646731 +0000 UTC m=+32.626012484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs") pod "router-default-6c8767fbdc-sxmpb" (UID: "cc3ee40a-be4e-476f-91ff-a0cd164812fc") : secret "router-metrics-certs-default" not found Oct 30 21:53:00.520904 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518706 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 21:53:00.520904 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518740 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls podName:4846560b-5370-4fa1-8d36-43dfc4011191 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:02.518729902 +0000 UTC m=+32.626095672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-d6jlp" (UID: "4846560b-5370-4fa1-8d36-43dfc4011191") : secret "cluster-monitoring-operator-tls" not found Oct 30 21:53:00.520904 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518812 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 21:53:00.520904 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518823 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b99f4cc75-7drms: secret "image-registry-tls" not found Oct 30 21:53:00.520904 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518946 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 21:53:00.521350 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.518871 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls podName:9ca45dcf-d2cd-4797-be23-47d5ac33b57b nodeName:}" failed. No retries permitted until 2026-10-30 21:53:02.518845935 +0000 UTC m=+32.626211678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls") pod "image-registry-7b99f4cc75-7drms" (UID: "9ca45dcf-d2cd-4797-be23-47d5ac33b57b") : secret "image-registry-tls" not found Oct 30 21:53:00.521350 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:00.521336 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls podName:3d901cac-9d8d-48f8-b1a6-61ae43d46721 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:02.52131567 +0000 UTC m=+32.628681412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls") pod "dns-default-sq7zn" (UID: "3d901cac-9d8d-48f8-b1a6-61ae43d46721") : secret "dns-default-metrics-tls" not found Oct 30 21:53:00.681196 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:00.681167 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:00.799003 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:00.798838 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:01.828642 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:01.827392 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:01.828642 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:01.827662 2580 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 21:53:01.858141 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:01.857809 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:02.036611 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:02.036576 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:02.141592 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:02.141565 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:02.540722 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:02.540776 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:02.540813 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:02.540891 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:02.540926 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:02.540991 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-4fs6t\" (UID: \"38da3026-ac7f-44af-aa6c-f16cf3082c9e\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:02.541018 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:02.541048 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.541195 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.541257 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs podName:cc3ee40a-be4e-476f-91ff-a0cd164812fc nodeName:}" failed. No retries permitted until 2026-10-30 21:53:06.541239879 +0000 UTC m=+36.648605628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs") pod "router-default-6c8767fbdc-sxmpb" (UID: "cc3ee40a-be4e-476f-91ff-a0cd164812fc") : secret "router-metrics-certs-default" not found Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.541674 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.541724 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls podName:4846560b-5370-4fa1-8d36-43dfc4011191 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:06.541708137 +0000 UTC m=+36.649073884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-d6jlp" (UID: "4846560b-5370-4fa1-8d36-43dfc4011191") : secret "cluster-monitoring-operator-tls" not found Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.541787 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.541799 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b99f4cc75-7drms: secret "image-registry-tls" not found Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.541832 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls podName:9ca45dcf-d2cd-4797-be23-47d5ac33b57b nodeName:}" failed. No retries permitted until 2026-10-30 21:53:06.541821085 +0000 UTC m=+36.649186830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls") pod "image-registry-7b99f4cc75-7drms" (UID: "9ca45dcf-d2cd-4797-be23-47d5ac33b57b") : secret "image-registry-tls" not found Oct 30 21:53:02.542282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.541903 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 21:53:02.543127 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.541933 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls podName:3d901cac-9d8d-48f8-b1a6-61ae43d46721 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:06.541923298 +0000 UTC m=+36.649289041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls") pod "dns-default-sq7zn" (UID: "3d901cac-9d8d-48f8-b1a6-61ae43d46721") : secret "dns-default-metrics-tls" not found Oct 30 21:53:02.543127 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.541980 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 21:53:02.543127 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.542009 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls podName:c41902e8-bf12-4ecc-a6e1-b87582b20f86 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:06.541999485 +0000 UTC m=+36.649365228 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-kgnrh" (UID: "c41902e8-bf12-4ecc-a6e1-b87582b20f86") : secret "samples-operator-tls" not found Oct 30 21:53:02.543127 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.542068 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle podName:cc3ee40a-be4e-476f-91ff-a0cd164812fc nodeName:}" failed. No retries permitted until 2026-10-30 21:53:06.542059734 +0000 UTC m=+36.649425475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle") pod "router-default-6c8767fbdc-sxmpb" (UID: "cc3ee40a-be4e-476f-91ff-a0cd164812fc") : configmap references non-existent config key: service-ca.crt Oct 30 21:53:02.543127 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.542114 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 21:53:02.543127 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.542141 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert podName:38da3026-ac7f-44af-aa6c-f16cf3082c9e nodeName:}" failed. No retries permitted until 2026-10-30 21:53:06.542132843 +0000 UTC m=+36.649498585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-4fs6t" (UID: "38da3026-ac7f-44af-aa6c-f16cf3082c9e") : secret "networking-console-plugin-cert" not found Oct 30 21:53:02.543127 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.542206 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 21:53:02.543127 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.542217 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6585488f54-nw2ht: secret "image-registry-tls" not found Oct 30 21:53:02.543127 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:02.542245 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls podName:012b8527-ec34-4639-b76c-5f941b31d02d nodeName:}" failed. No retries permitted until 2026-10-30 21:53:06.542234728 +0000 UTC m=+36.649600473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls") pod "image-registry-6585488f54-nw2ht" (UID: "012b8527-ec34-4639-b76c-5f941b31d02d") : secret "image-registry-tls" not found Oct 30 21:53:02.590399 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:02.590365 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-l9ktm" event={"ID":"6f371722-dc8f-48eb-8f8c-28f394ef4360","Type":"ContainerStarted","Data":"810a260bbef76420ac4fb8af6b9a82fbf43b0b3c25a4834d1810cb039fa25619"} Oct 30 21:53:02.765871 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:02.765811 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:02.891555 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:02.891406 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:03.052167 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:03.052129 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:03.594290 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:03.594259 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" event={"ID":"7c068922-cad3-472a-a20a-890955ecb231","Type":"ContainerStarted","Data":"98972e555b26e7b24a00b741e59776374962318da62714bcafb6ebea673676c3"} Oct 30 21:53:04.060315 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.058983 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:53:04.060315 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.059101 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:53:04.060315 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:04.059286 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 21:53:04.060315 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:04.059341 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs podName:b6b30cd9-d376-4e9e-8f95-d4d2c504cd93 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:36.05932356 +0000 UTC m=+66.166689302 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs") pod "network-metrics-daemon-ztlk7" (UID: "b6b30cd9-d376-4e9e-8f95-d4d2c504cd93") : secret "metrics-daemon-secret" not found Oct 30 21:53:04.064363 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.064335 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:53:04.160385 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.160347 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgp75\" (UniqueName: \"kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75\") pod \"network-check-target-dxkrb\" (UID: \"c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b\") " pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:53:04.163475 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.163448 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgp75\" (UniqueName: \"kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75\") pod \"network-check-target-dxkrb\" (UID: \"c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b\") " pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:53:04.163644 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.163568 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:53:04.456276 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.456197 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:53:04.497889 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.497565 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-l9ktm" podStartSLOduration=367.334145691 podStartE2EDuration="6m9.497551217s" totalImagesPullingTime="2.163405526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:02.612333003 +0000 UTC m=+32.719698755" watchObservedRunningTime="2026-10-30 21:53:04.497551217 +0000 UTC m=+34.604916967" Oct 30 21:53:04.498027 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.497945 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s5jhm"] Oct 30 21:53:04.598823 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.598784 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/0.log" Oct 30 21:53:04.599015 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.598838 2580 generic.go:356] "Generic (PLEG): container finished" podID="7c068922-cad3-472a-a20a-890955ecb231" containerID="98972e555b26e7b24a00b741e59776374962318da62714bcafb6ebea673676c3" exitCode=255 Oct 30 21:53:04.599015 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.598922 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" event={"ID":"7c068922-cad3-472a-a20a-890955ecb231","Type":"ContainerDied","Data":"98972e555b26e7b24a00b741e59776374962318da62714bcafb6ebea673676c3"} Oct 30 21:53:04.599182 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.599152 2580 scope.go:122] "RemoveContainer" containerID="98972e555b26e7b24a00b741e59776374962318da62714bcafb6ebea673676c3" Oct 30 21:53:04.600876 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.600834 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" event={"ID":"88107d0e-6b47-4320-8647-2a597f418bf4","Type":"ContainerStarted","Data":"33e08809e472a4f87cb688884520143791e4e4743e252e0fdd4841898dfef3c4"} Oct 30 21:53:04.602591 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.602547 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" event={"ID":"a4646859-cf39-4d6b-a2e2-f2795635390c","Type":"ContainerStarted","Data":"57cdbfcc8db6c5ae157e726ee05bba9d9443b165c4d3d7e003f0c4709f71a837"} Oct 30 21:53:04.604350 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.604326 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-frqg6" event={"ID":"3cfcee7d-4a08-441e-874b-5486b381d0f2","Type":"ContainerStarted","Data":"47e4c6ae9cabd43d1a3d7fa263fb931626773b0e97b536b0d9b1cfc1bf32f542"} Oct 30 21:53:04.641593 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.641552 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-frqg6" podStartSLOduration=364.913940002 podStartE2EDuration="6m9.641540081s" totalImagesPullingTime="4.727600079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:04.640801508 +0000 UTC m=+34.748167259" watchObservedRunningTime="2026-10-30 21:53:04.641540081 +0000 UTC m=+34.748905833" Oct 30 21:53:04.646565 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:53:04.646541 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967b7974_ef9d_4eff_8265_879c05e6fc96.slice/crio-0b3172c12fe0cb80cb0ba689d2dc46ebb3add53f9f68ecb66db1e0f3c7e8f35f WatchSource:0}: Error finding container 0b3172c12fe0cb80cb0ba689d2dc46ebb3add53f9f68ecb66db1e0f3c7e8f35f: Status 404 returned error can't find the container with id 0b3172c12fe0cb80cb0ba689d2dc46ebb3add53f9f68ecb66db1e0f3c7e8f35f Oct 30 21:53:04.692345 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.692294 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" podStartSLOduration=364.901703527 podStartE2EDuration="6m9.692276155s" totalImagesPullingTime="4.790572628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:04.691103012 +0000 UTC m=+34.798468775" watchObservedRunningTime="2026-10-30 21:53:04.692276155 +0000 UTC m=+34.799641907" Oct 30 21:53:04.692446 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.692401 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" podStartSLOduration=365.006623742 podStartE2EDuration="6m9.692394677s" totalImagesPullingTime="4.685770935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:04.670197502 +0000 UTC m=+34.777563257" watchObservedRunningTime="2026-10-30 21:53:04.692394677 +0000 UTC m=+34.799760430" Oct 30 21:53:04.985506 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:04.985476 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dxkrb"] Oct 30 21:53:05.047607 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.047567 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:05.066592 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.066566 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-bl46l"] Oct 30 21:53:05.087677 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.087657 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bl46l" Oct 30 21:53:05.094273 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.093284 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 21:53:05.094273 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.093764 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-bl46l"] Oct 30 21:53:05.094469 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.094270 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9kpks\"" Oct 30 21:53:05.096680 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.096656 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-lhvx9"] Oct 30 21:53:05.100055 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:53:05.100030 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc68f1e16_d0d1_49a8_ab35_a9ce2c4a8c2b.slice/crio-9a39dd8b961fd22403f9e2c2b627062c216c0b0691f62c971e2510f2c01c28a9 WatchSource:0}: Error finding container 9a39dd8b961fd22403f9e2c2b627062c216c0b0691f62c971e2510f2c01c28a9: Status 404 returned error can't find the container with id 9a39dd8b961fd22403f9e2c2b627062c216c0b0691f62c971e2510f2c01c28a9 Oct 30 21:53:05.114450 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.114425 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lhvx9" Oct 30 21:53:05.118047 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.118016 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-lhvx9"] Oct 30 21:53:05.170330 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.170310 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rgkfs"] Oct 30 21:53:05.175847 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.175826 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87f7c\" (UniqueName: \"kubernetes.io/projected/daafa095-7904-4d87-ad51-83577c6d1452-kube-api-access-87f7c\") pod \"migrator-66df5d496b-bl46l\" (UID: \"daafa095-7904-4d87-ad51-83577c6d1452\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bl46l" Oct 30 21:53:05.201676 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.201660 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 21:53:05.203007 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.202991 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-lzjkn-79bnz"] Oct 30 21:53:05.203166 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.203150 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.209899 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.209847 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 21:53:05.210331 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.210314 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-whw8p\"" Oct 30 21:53:05.225372 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.225350 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-lzjkn-79bnz"] Oct 30 21:53:05.225478 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.225389 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rgkfs"] Oct 30 21:53:05.225536 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.225491 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:05.277574 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.277487 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87f7c\" (UniqueName: \"kubernetes.io/projected/daafa095-7904-4d87-ad51-83577c6d1452-kube-api-access-87f7c\") pod \"migrator-66df5d496b-bl46l\" (UID: \"daafa095-7904-4d87-ad51-83577c6d1452\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bl46l" Oct 30 21:53:05.277574 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.277540 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9101efec-ec15-4f30-929d-a3bcfd851caa-data-volume\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.277771 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.277575 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9101efec-ec15-4f30-929d-a3bcfd851caa-crio-socket\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.277771 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.277605 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.277771 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.277654 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m25k7\" (UniqueName: \"kubernetes.io/projected/187603a7-5181-4c01-b7d2-3d7a56796255-kube-api-access-m25k7\") pod \"migrator-66df5d496b-lhvx9\" (UID: \"187603a7-5181-4c01-b7d2-3d7a56796255\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lhvx9" Oct 30 21:53:05.277950 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.277772 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dqrt\" (UniqueName: \"kubernetes.io/projected/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-api-access-9dqrt\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.277950 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.277842 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.297208 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.297174 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87f7c\" (UniqueName: \"kubernetes.io/projected/daafa095-7904-4d87-ad51-83577c6d1452-kube-api-access-87f7c\") pod \"migrator-66df5d496b-bl46l\" (UID: \"daafa095-7904-4d87-ad51-83577c6d1452\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bl46l" Oct 30 21:53:05.304869 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.304838 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 21:53:05.335953 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.335920 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:05.379237 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.379205 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/f2746830-9846-4bb6-afc2-713e6a5cd2e8-archives-path\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:05.379373 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.379263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9101efec-ec15-4f30-929d-a3bcfd851caa-data-volume\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.379373 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.379347 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9101efec-ec15-4f30-929d-a3bcfd851caa-crio-socket\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.379457 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.379388 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.379457 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.379440 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m25k7\" (UniqueName: \"kubernetes.io/projected/187603a7-5181-4c01-b7d2-3d7a56796255-kube-api-access-m25k7\") pod \"migrator-66df5d496b-lhvx9\" (UID: \"187603a7-5181-4c01-b7d2-3d7a56796255\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lhvx9" Oct 30 21:53:05.379549 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.379465 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9101efec-ec15-4f30-929d-a3bcfd851caa-crio-socket\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.379549 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.379485 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c7wj\" (UniqueName: \"kubernetes.io/projected/f2746830-9846-4bb6-afc2-713e6a5cd2e8-kube-api-access-8c7wj\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:05.379549 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.379537 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dqrt\" (UniqueName: \"kubernetes.io/projected/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-api-access-9dqrt\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.379654 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:05.379560 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 21:53:05.379654 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:05.379620 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls podName:9101efec-ec15-4f30-929d-a3bcfd851caa nodeName:}" failed. No retries permitted until 2026-10-30 21:53:05.879601544 +0000 UTC m=+35.986967297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rgkfs" (UID: "9101efec-ec15-4f30-929d-a3bcfd851caa") : secret "insights-runtime-extractor-tls" not found Oct 30 21:53:05.379654 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.379623 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9101efec-ec15-4f30-929d-a3bcfd851caa-data-volume\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.379654 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.379565 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-trusted-ca-bundle\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:05.379790 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.379673 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.379790 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.379701 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-service-ca-bundle\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:05.379790 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:05.379738 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 21:53:05.379790 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:05.379785 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm podName:9101efec-ec15-4f30-929d-a3bcfd851caa nodeName:}" failed. No retries permitted until 2026-10-30 21:53:05.879770534 +0000 UTC m=+35.987136277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rgkfs" (UID: "9101efec-ec15-4f30-929d-a3bcfd851caa") : configmap "kube-rbac-proxy" not found Oct 30 21:53:05.402019 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.401991 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dqrt\" (UniqueName: \"kubernetes.io/projected/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-api-access-9dqrt\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.402653 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.402624 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m25k7\" (UniqueName: \"kubernetes.io/projected/187603a7-5181-4c01-b7d2-3d7a56796255-kube-api-access-m25k7\") pod \"migrator-66df5d496b-lhvx9\" (UID: \"187603a7-5181-4c01-b7d2-3d7a56796255\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lhvx9" Oct 30 21:53:05.418839 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.418816 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bl46l" Oct 30 21:53:05.445096 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.445077 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lhvx9" Oct 30 21:53:05.472585 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.472561 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-d9ljx"] Oct 30 21:53:05.480626 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.480602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/f2746830-9846-4bb6-afc2-713e6a5cd2e8-archives-path\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:05.480749 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.480731 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c7wj\" (UniqueName: \"kubernetes.io/projected/f2746830-9846-4bb6-afc2-713e6a5cd2e8-kube-api-access-8c7wj\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:05.480806 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.480782 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-trusted-ca-bundle\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:05.480869 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.480820 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-service-ca-bundle\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:05.481757 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.481065 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/f2746830-9846-4bb6-afc2-713e6a5cd2e8-archives-path\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:05.481757 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.481631 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-service-ca-bundle\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:05.481757 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.481707 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-trusted-ca-bundle\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:05.493806 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.493408 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:05.498926 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.498883 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-42md8\"" Oct 30 21:53:05.500161 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.500081 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 30 21:53:05.507153 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.507123 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 30 21:53:05.507277 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.507260 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 30 21:53:05.507362 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.507338 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 30 21:53:05.519198 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.519159 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c7wj\" (UniqueName: \"kubernetes.io/projected/f2746830-9846-4bb6-afc2-713e6a5cd2e8-kube-api-access-8c7wj\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:05.526569 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.526451 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-d9ljx"] Oct 30 21:53:05.563716 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.563688 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:05.582239 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.582214 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-signing-key\") pod \"service-ca-5fffc97bdf-d9ljx\" (UID: \"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:05.582333 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.582286 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-signing-cabundle\") pod \"service-ca-5fffc97bdf-d9ljx\" (UID: \"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:05.582389 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.582377 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf456\" (UniqueName: \"kubernetes.io/projected/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-kube-api-access-vf456\") pod \"service-ca-5fffc97bdf-d9ljx\" (UID: \"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:05.593131 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.593109 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:05.610448 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.610419 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rsx79" event={"ID":"3444842c-2f38-409f-ba87-e21af956df52","Type":"ContainerStarted","Data":"557b783dd46856fdb0ea87e82c396be7d59ae5f313825d5361d0454f77772b6e"} Oct 30 21:53:05.612360 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.612311 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sgzrz" event={"ID":"181f4022-4f53-4e23-8424-01f6b5e06ec6","Type":"ContainerStarted","Data":"86364fd39cf269b297ba62a92931c0fc5666f23bead1548c1fc7f4bc238d040d"} Oct 30 21:53:05.615328 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.615306 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/1.log" Oct 30 21:53:05.615954 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.615936 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/0.log" Oct 30 21:53:05.616040 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.615971 2580 generic.go:356] "Generic (PLEG): container finished" podID="7c068922-cad3-472a-a20a-890955ecb231" containerID="0460225e186b8a286a1732a9d921f46e9978325a451def36afdb4689d7eb8151" exitCode=255 Oct 30 21:53:05.616097 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.616042 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" event={"ID":"7c068922-cad3-472a-a20a-890955ecb231","Type":"ContainerDied","Data":"0460225e186b8a286a1732a9d921f46e9978325a451def36afdb4689d7eb8151"} Oct 30 21:53:05.616097 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.616082 2580 scope.go:122] "RemoveContainer" containerID="98972e555b26e7b24a00b741e59776374962318da62714bcafb6ebea673676c3" Oct 30 21:53:05.616455 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.616437 2580 scope.go:122] "RemoveContainer" containerID="0460225e186b8a286a1732a9d921f46e9978325a451def36afdb4689d7eb8151" Oct 30 21:53:05.616644 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:05.616622 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-hn7m5_openshift-console-operator(7c068922-cad3-472a-a20a-890955ecb231)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" podUID="7c068922-cad3-472a-a20a-890955ecb231" Oct 30 21:53:05.621372 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.621325 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dxkrb" event={"ID":"c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b","Type":"ContainerStarted","Data":"9a39dd8b961fd22403f9e2c2b627062c216c0b0691f62c971e2510f2c01c28a9"} Oct 30 21:53:05.622870 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.622724 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s5jhm" event={"ID":"967b7974-ef9d-4eff-8265-879c05e6fc96","Type":"ContainerStarted","Data":"0b3172c12fe0cb80cb0ba689d2dc46ebb3add53f9f68ecb66db1e0f3c7e8f35f"} Oct 30 21:53:05.635063 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.635023 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rsx79" podStartSLOduration=364.956444502 podStartE2EDuration="6m10.635010973s" totalImagesPullingTime="5.678566471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:05.632346206 +0000 UTC m=+35.739711955" watchObservedRunningTime="2026-10-30 21:53:05.635010973 +0000 UTC m=+35.742376723" Oct 30 21:53:05.684614 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.684580 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf456\" (UniqueName: \"kubernetes.io/projected/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-kube-api-access-vf456\") pod \"service-ca-5fffc97bdf-d9ljx\" (UID: \"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:05.684731 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.684710 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-signing-key\") pod \"service-ca-5fffc97bdf-d9ljx\" (UID: \"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:05.684836 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.684815 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-signing-cabundle\") pod \"service-ca-5fffc97bdf-d9ljx\" (UID: \"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:05.688884 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.685587 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-signing-cabundle\") pod \"service-ca-5fffc97bdf-d9ljx\" (UID: \"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:05.693576 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.693552 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-signing-key\") pod \"service-ca-5fffc97bdf-d9ljx\" (UID: \"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:05.701636 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.701599 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf456\" (UniqueName: \"kubernetes.io/projected/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-kube-api-access-vf456\") pod \"service-ca-5fffc97bdf-d9ljx\" (UID: \"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:05.725328 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.725290 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:05.733199 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.733144 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sgzrz" podStartSLOduration=2.580546022 podStartE2EDuration="7.733123333s" totalImagesPullingTime="5.152577311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:05.688333015 +0000 UTC m=+35.795698768" watchObservedRunningTime="2026-10-30 21:53:05.733123333 +0000 UTC m=+35.840489085" Oct 30 21:53:05.733717 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.733695 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-bl46l"] Oct 30 21:53:05.736681 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:53:05.736650 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaafa095_7904_4d87_ad51_83577c6d1452.slice/crio-bb05a8002385ca2c83912d89a0e310ae5ad9ce143cce5629f9ecd78f5fdcd687 WatchSource:0}: Error finding container bb05a8002385ca2c83912d89a0e310ae5ad9ce143cce5629f9ecd78f5fdcd687: Status 404 returned error can't find the container with id bb05a8002385ca2c83912d89a0e310ae5ad9ce143cce5629f9ecd78f5fdcd687 Oct 30 21:53:05.765931 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.765907 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-lhvx9"] Oct 30 21:53:05.768970 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:53:05.768941 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod187603a7_5181_4c01_b7d2_3d7a56796255.slice/crio-75c168f1e94c8dd3d0c1196e9fba99847b5fb8f5eaeca5410cc43ca5c246e956 WatchSource:0}: Error finding container 75c168f1e94c8dd3d0c1196e9fba99847b5fb8f5eaeca5410cc43ca5c246e956: Status 404 returned error can't find the container with id 75c168f1e94c8dd3d0c1196e9fba99847b5fb8f5eaeca5410cc43ca5c246e956 Oct 30 21:53:05.857331 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.857228 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:05.863840 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.863814 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:05.887645 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.887618 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.887751 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.887729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:05.887894 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:05.887875 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 21:53:05.887968 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:05.887953 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm podName:9101efec-ec15-4f30-929d-a3bcfd851caa nodeName:}" failed. No retries permitted until 2026-10-30 21:53:06.887930844 +0000 UTC m=+36.995296576 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rgkfs" (UID: "9101efec-ec15-4f30-929d-a3bcfd851caa") : configmap "kube-rbac-proxy" not found Oct 30 21:53:05.888237 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:05.888221 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 21:53:05.888311 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:05.888282 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls podName:9101efec-ec15-4f30-929d-a3bcfd851caa nodeName:}" failed. No retries permitted until 2026-10-30 21:53:06.888264024 +0000 UTC m=+36.995629753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rgkfs" (UID: "9101efec-ec15-4f30-929d-a3bcfd851caa") : secret "insights-runtime-extractor-tls" not found Oct 30 21:53:05.891376 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:05.891353 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-lzjkn-79bnz"] Oct 30 21:53:05.895325 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:53:05.895301 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2746830_9846_4bb6_afc2_713e6a5cd2e8.slice/crio-0533de5ce33c93f1a7d2aa0f2ab6c42fa530f57d6b8738521c09b572d19803bf WatchSource:0}: Error finding container 0533de5ce33c93f1a7d2aa0f2ab6c42fa530f57d6b8738521c09b572d19803bf: Status 404 returned error can't find the container with id 0533de5ce33c93f1a7d2aa0f2ab6c42fa530f57d6b8738521c09b572d19803bf Oct 30 21:53:06.175403 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.175333 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-d9ljx"] Oct 30 21:53:06.178539 ip-10-0-140-139 kubenswrapper[2580]: W1030 21:53:06.178513 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40aa6e8d_b731_4ab3_990c_8e9cb8bd582b.slice/crio-91bfb21752db6aabeb4d104750f48bbe268e6dc56df1f80dfb7a6dd4afe52f94 WatchSource:0}: Error finding container 91bfb21752db6aabeb4d104750f48bbe268e6dc56df1f80dfb7a6dd4afe52f94: Status 404 returned error can't find the container with id 91bfb21752db6aabeb4d104750f48bbe268e6dc56df1f80dfb7a6dd4afe52f94 Oct 30 21:53:06.399504 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.399466 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:06.594307 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.594269 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:53:06.594507 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.594321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:06.594507 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.594384 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-4fs6t\" (UID: \"38da3026-ac7f-44af-aa6c-f16cf3082c9e\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:53:06.594507 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.594416 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:06.594507 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.594438 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 21:53:06.594679 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.594445 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:06.595282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.594919 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 21:53:06.595282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.595111 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls podName:c41902e8-bf12-4ecc-a6e1-b87582b20f86 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:14.594493143 +0000 UTC m=+44.701858889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-kgnrh" (UID: "c41902e8-bf12-4ecc-a6e1-b87582b20f86") : secret "samples-operator-tls" not found Oct 30 21:53:06.595282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.595143 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 21:53:06.595282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.595164 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6585488f54-nw2ht: secret "image-registry-tls" not found Oct 30 21:53:06.595282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.595151 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs podName:cc3ee40a-be4e-476f-91ff-a0cd164812fc nodeName:}" failed. No retries permitted until 2026-10-30 21:53:14.595134986 +0000 UTC m=+44.702500716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs") pod "router-default-6c8767fbdc-sxmpb" (UID: "cc3ee40a-be4e-476f-91ff-a0cd164812fc") : secret "router-metrics-certs-default" not found Oct 30 21:53:06.595282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.595222 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 21:53:06.595282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.595247 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle podName:cc3ee40a-be4e-476f-91ff-a0cd164812fc nodeName:}" failed. No retries permitted until 2026-10-30 21:53:14.595223491 +0000 UTC m=+44.702589237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle") pod "router-default-6c8767fbdc-sxmpb" (UID: "cc3ee40a-be4e-476f-91ff-a0cd164812fc") : configmap references non-existent config key: service-ca.crt Oct 30 21:53:06.595282 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.595270 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls podName:012b8527-ec34-4639-b76c-5f941b31d02d nodeName:}" failed. No retries permitted until 2026-10-30 21:53:14.595256 +0000 UTC m=+44.702621728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls") pod "image-registry-6585488f54-nw2ht" (UID: "012b8527-ec34-4639-b76c-5f941b31d02d") : secret "image-registry-tls" not found Oct 30 21:53:06.595789 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.595295 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert podName:38da3026-ac7f-44af-aa6c-f16cf3082c9e nodeName:}" failed. No retries permitted until 2026-10-30 21:53:14.595279473 +0000 UTC m=+44.702645205 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-4fs6t" (UID: "38da3026-ac7f-44af-aa6c-f16cf3082c9e") : secret "networking-console-plugin-cert" not found Oct 30 21:53:06.595789 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.595400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:53:06.595789 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.595452 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:06.595789 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.595532 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 21:53:06.595789 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.595542 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b99f4cc75-7drms: secret "image-registry-tls" not found Oct 30 21:53:06.595789 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.595583 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls podName:9ca45dcf-d2cd-4797-be23-47d5ac33b57b nodeName:}" failed. No retries permitted until 2026-10-30 21:53:14.595572123 +0000 UTC m=+44.702937870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls") pod "image-registry-7b99f4cc75-7drms" (UID: "9ca45dcf-d2cd-4797-be23-47d5ac33b57b") : secret "image-registry-tls" not found Oct 30 21:53:06.595789 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.595657 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 21:53:06.595789 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.595696 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls podName:4846560b-5370-4fa1-8d36-43dfc4011191 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:14.595685855 +0000 UTC m=+44.703051597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-d6jlp" (UID: "4846560b-5370-4fa1-8d36-43dfc4011191") : secret "cluster-monitoring-operator-tls" not found Oct 30 21:53:06.596193 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.596105 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:06.598893 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.596298 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 21:53:06.598893 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.596353 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls podName:3d901cac-9d8d-48f8-b1a6-61ae43d46721 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:14.596339712 +0000 UTC m=+44.703705459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls") pod "dns-default-sq7zn" (UID: "3d901cac-9d8d-48f8-b1a6-61ae43d46721") : secret "dns-default-metrics-tls" not found Oct 30 21:53:06.634210 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.634181 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/1.log" Oct 30 21:53:06.634852 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.634583 2580 scope.go:122] "RemoveContainer" containerID="0460225e186b8a286a1732a9d921f46e9978325a451def36afdb4689d7eb8151" Oct 30 21:53:06.634852 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.634791 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-hn7m5_openshift-console-operator(7c068922-cad3-472a-a20a-890955ecb231)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" podUID="7c068922-cad3-472a-a20a-890955ecb231" Oct 30 21:53:06.638252 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.638224 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dxkrb" event={"ID":"c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b","Type":"ContainerStarted","Data":"408a40dbb5adc8e90f5bae9a6d4c0dfcb3d3fc7238f5c52cb039c545655f4531"} Oct 30 21:53:06.638869 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.638833 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:53:06.641415 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.641342 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" event={"ID":"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b","Type":"ContainerStarted","Data":"824d1d869445ab621843f3261b1a6c4b07b1176e91c5201eeba0056b397cb4e1"} Oct 30 21:53:06.641415 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.641387 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" event={"ID":"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b","Type":"ContainerStarted","Data":"91bfb21752db6aabeb4d104750f48bbe268e6dc56df1f80dfb7a6dd4afe52f94"} Oct 30 21:53:06.642790 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.642735 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lhvx9" event={"ID":"187603a7-5181-4c01-b7d2-3d7a56796255","Type":"ContainerStarted","Data":"75c168f1e94c8dd3d0c1196e9fba99847b5fb8f5eaeca5410cc43ca5c246e956"} Oct 30 21:53:06.645944 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.645495 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-lzjkn-79bnz" event={"ID":"f2746830-9846-4bb6-afc2-713e6a5cd2e8","Type":"ContainerStarted","Data":"3251da8823730b5f857cda7fe38c5a7e87706ef47297387294bd2f2182375f54"} Oct 30 21:53:06.645944 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.645539 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-lzjkn-79bnz" event={"ID":"f2746830-9846-4bb6-afc2-713e6a5cd2e8","Type":"ContainerStarted","Data":"0533de5ce33c93f1a7d2aa0f2ab6c42fa530f57d6b8738521c09b572d19803bf"} Oct 30 21:53:06.648476 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.648449 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bl46l" event={"ID":"daafa095-7904-4d87-ad51-83577c6d1452","Type":"ContainerStarted","Data":"bb05a8002385ca2c83912d89a0e310ae5ad9ce143cce5629f9ecd78f5fdcd687"} Oct 30 21:53:06.688031 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.687969 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dxkrb" podStartSLOduration=35.912661865 podStartE2EDuration="36.68795089s" totalImagesPullingTime="775.289025ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:06.686190062 +0000 UTC m=+36.793555815" watchObservedRunningTime="2026-10-30 21:53:06.68795089 +0000 UTC m=+36.795316642" Oct 30 21:53:06.737165 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.737103 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-lzjkn-79bnz" podStartSLOduration=1.737084313 podStartE2EDuration="1.737084313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:06.711067487 +0000 UTC m=+36.818433238" watchObservedRunningTime="2026-10-30 21:53:06.737084313 +0000 UTC m=+36.844450062" Oct 30 21:53:06.902213 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.901357 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:06.902213 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.901471 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:06.902213 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.901613 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 21:53:06.902213 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.901677 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm podName:9101efec-ec15-4f30-929d-a3bcfd851caa nodeName:}" failed. No retries permitted until 2026-10-30 21:53:08.901657724 +0000 UTC m=+39.009023473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rgkfs" (UID: "9101efec-ec15-4f30-929d-a3bcfd851caa") : configmap "kube-rbac-proxy" not found Oct 30 21:53:06.902213 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.902087 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 21:53:06.902213 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:06.902132 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls podName:9101efec-ec15-4f30-929d-a3bcfd851caa nodeName:}" failed. No retries permitted until 2026-10-30 21:53:08.902118398 +0000 UTC m=+39.009484141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rgkfs" (UID: "9101efec-ec15-4f30-929d-a3bcfd851caa") : secret "insights-runtime-extractor-tls" not found Oct 30 21:53:06.999243 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:06.999125 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:07.199518 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:07.199423 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:07.336069 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:07.334755 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:07.743259 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:07.743219 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:08.050419 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:08.050340 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4d225_4d4e36e4-7ca2-4e4f-837d-ebdef77734b1/dns-node-resolver/0.log" Oct 30 21:53:08.309442 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:08.309346 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:08.658383 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:08.658305 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bl46l" event={"ID":"daafa095-7904-4d87-ad51-83577c6d1452","Type":"ContainerStarted","Data":"ac67e2b83c49f2ddb77eea5ddda471dba80505887cb12e17b8ccd844eb0f129b"} Oct 30 21:53:08.659969 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:08.659933 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lhvx9" event={"ID":"187603a7-5181-4c01-b7d2-3d7a56796255","Type":"ContainerStarted","Data":"bd4b6899ef6583f798c12fa324584c158a3a98d4370441090e26ac74d5c284fa"} Oct 30 21:53:08.676110 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:08.676067 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bl46l" podStartSLOduration=1.582817023 podStartE2EDuration="3.676054712s" totalImagesPullingTime="2.093237689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:08.675078172 +0000 UTC m=+38.782443922" watchObservedRunningTime="2026-10-30 21:53:08.676054712 +0000 UTC m=+38.783420465" Oct 30 21:53:08.676580 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:08.676555 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" podStartSLOduration=3.676549485 podStartE2EDuration="3.676549485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:06.737894682 +0000 UTC m=+36.845260435" watchObservedRunningTime="2026-10-30 21:53:08.676549485 +0000 UTC m=+38.783915235" Oct 30 21:53:08.695974 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:08.695930 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lhvx9" podStartSLOduration=1.6376837640000002 podStartE2EDuration="3.695918625s" totalImagesPullingTime="2.058234861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:08.695244534 +0000 UTC m=+38.802610285" watchObservedRunningTime="2026-10-30 21:53:08.695918625 +0000 UTC m=+38.803284427" Oct 30 21:53:08.920723 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:08.920638 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:08.923806 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:08.923773 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:08.923957 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:08.923899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:08.923957 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:08.923939 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 21:53:08.924078 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:08.923991 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 21:53:08.924078 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:08.924003 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls podName:9101efec-ec15-4f30-929d-a3bcfd851caa nodeName:}" failed. No retries permitted until 2026-10-30 21:53:12.923989248 +0000 UTC m=+43.031354994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rgkfs" (UID: "9101efec-ec15-4f30-929d-a3bcfd851caa") : secret "insights-runtime-extractor-tls" not found Oct 30 21:53:08.924078 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:08.924044 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm podName:9101efec-ec15-4f30-929d-a3bcfd851caa nodeName:}" failed. No retries permitted until 2026-10-30 21:53:12.924029452 +0000 UTC m=+43.031395195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rgkfs" (UID: "9101efec-ec15-4f30-929d-a3bcfd851caa") : configmap "kube-rbac-proxy" not found Oct 30 21:53:09.049632 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:09.049601 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dgfl4_dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a/node-ca/0.log" Oct 30 21:53:09.142568 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:09.142514 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:09.166452 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:09.166423 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:53:09.166581 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:09.166485 2580 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:53:09.166921 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:09.166904 2580 scope.go:122] "RemoveContainer" containerID="0460225e186b8a286a1732a9d921f46e9978325a451def36afdb4689d7eb8151" Oct 30 21:53:09.167153 ip-10-0-140-139 kubenswrapper[2580]: E1030 21:53:09.167131 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-hn7m5_openshift-console-operator(7c068922-cad3-472a-a20a-890955ecb231)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" podUID="7c068922-cad3-472a-a20a-890955ecb231" Oct 30 21:53:09.250233 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:09.250197 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:09.447169 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:09.447125 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sgzrz_181f4022-4f53-4e23-8424-01f6b5e06ec6/serve-healthcheck-canary/0.log" Oct 30 21:53:09.518758 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:09.518666 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:09.648410 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:09.648380 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-bl46l_daafa095-7904-4d87-ad51-83577c6d1452/migrator/0.log" Oct 30 21:53:09.724162 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:09.724133 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:09.848170 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:09.848101 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-lhvx9_187603a7-5181-4c01-b7d2-3d7a56796255/migrator/0.log" Oct 30 21:53:09.906254 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:09.906214 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:10.049052 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:10.049020 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl_88107d0e-6b47-4320-8647-2a597f418bf4/kube-storage-version-migrator-operator/0.log" Oct 30 21:53:10.305157 ip-10-0-140-139 kubenswrapper[2580]: I1030 21:53:10.305125 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:10.411532 ip-10-0-140-139 systemd[1]: Stopping Kubernetes Kubelet... Oct 30 21:53:10.424198 ip-10-0-140-139 systemd[1]: kubelet.service: Deactivated successfully. Oct 30 21:53:10.424365 ip-10-0-140-139 systemd[1]: Stopped Kubernetes Kubelet. Oct 30 21:53:10.424535 ip-10-0-140-139 systemd[1]: kubelet.service: Consumed 3.092s CPU time. Oct 30 21:53:10.433407 ip-10-0-140-139 systemd[1]: Starting Kubernetes Kubelet... Oct 30 21:53:10.519795 ip-10-0-140-139 kubenswrapper[5052]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:53:10.519795 ip-10-0-140-139 kubenswrapper[5052]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 21:53:10.519795 ip-10-0-140-139 kubenswrapper[5052]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:53:10.519795 ip-10-0-140-139 kubenswrapper[5052]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:53:10.521841 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521761 5052 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:10.521841 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521841 5052 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521846 5052 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521849 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521852 5052 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521869 5052 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521872 5052 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521874 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521877 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521886 5052 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521889 5052 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521892 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521894 5052 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521897 5052 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521900 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521902 5052 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521905 5052 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521909 5052 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521914 5052 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521916 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:10.521934 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521919 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521923 5052 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521927 5052 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521930 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521933 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521936 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521939 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521942 5052 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521945 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521948 5052 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521951 5052 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521953 5052 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521956 5052 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521958 5052 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521961 5052 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521963 5052 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521966 5052 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521968 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521971 5052 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:10.522398 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521974 5052 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521977 5052 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521980 5052 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521983 5052 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521985 5052 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521987 5052 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521990 5052 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521993 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521996 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.521998 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522001 5052 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522003 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522006 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522011 5052 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522014 5052 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522016 5052 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522020 5052 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522022 5052 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522025 5052 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:10.522897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522028 5052 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522030 5052 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522033 5052 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522035 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522038 5052 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522041 5052 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522043 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522046 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522048 5052 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522051 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522053 5052 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522056 5052 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522058 5052 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522061 5052 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522064 5052 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522067 5052 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522070 5052 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522072 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522074 5052 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522077 5052 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:10.523351 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522080 5052 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522083 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522085 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522088 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522091 5052 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522093 5052 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522097 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522100 5052 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522103 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522105 5052 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522108 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522111 5052 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522114 5052 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522116 5052 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522119 5052 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522121 5052 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522124 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522126 5052 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522129 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522132 5052 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:10.523842 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522135 5052 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522137 5052 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522140 5052 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522142 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522145 5052 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522148 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522151 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522154 5052 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522891 5052 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522899 5052 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522903 5052 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522906 5052 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522910 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522913 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522915 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522918 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522920 5052 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522924 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522930 5052 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:10.524373 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522933 5052 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522935 5052 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522938 5052 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522941 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522943 5052 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522946 5052 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522948 5052 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522951 5052 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522953 5052 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522956 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522958 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522961 5052 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522964 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522966 5052 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522969 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522971 5052 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522974 5052 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522977 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522979 5052 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522982 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:10.524831 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522984 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522987 5052 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522990 5052 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522993 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522995 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.522998 5052 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523001 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523003 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523006 5052 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523009 5052 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523011 5052 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523015 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523018 5052 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523021 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523023 5052 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523026 5052 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523029 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523031 5052 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523034 5052 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:10.525366 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523037 5052 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523039 5052 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523042 5052 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523044 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523048 5052 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523052 5052 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523056 5052 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523060 5052 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523064 5052 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523067 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523070 5052 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523073 5052 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523075 5052 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523078 5052 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523081 5052 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523085 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523087 5052 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523090 5052 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523093 5052 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523096 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:10.525832 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523099 5052 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523101 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523104 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523107 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523113 5052 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523115 5052 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523118 5052 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523120 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523123 5052 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523126 5052 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523128 5052 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523131 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523134 5052 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523136 5052 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523139 5052 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523142 5052 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523144 5052 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523147 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523149 5052 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523152 5052 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:10.526322 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523155 5052 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523158 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523161 5052 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523165 5052 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523168 5052 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523172 5052 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523176 5052 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523180 5052 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523183 5052 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523186 5052 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523189 5052 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523192 5052 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523194 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523197 5052 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523200 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523204 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523710 5052 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523716 5052 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523719 5052 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:10.526837 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523722 5052 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523726 5052 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523728 5052 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523731 5052 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523734 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523736 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523739 5052 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523742 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523745 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523747 5052 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523750 5052 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523752 5052 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523755 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523758 5052 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523760 5052 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523763 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523765 5052 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523768 5052 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523770 5052 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523773 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:10.527338 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523777 5052 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523782 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523785 5052 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523788 5052 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523791 5052 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523794 5052 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523797 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523799 5052 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523802 5052 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523807 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523810 5052 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523812 5052 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523815 5052 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523817 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523820 5052 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523822 5052 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523825 5052 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523827 5052 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523830 5052 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:10.527825 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523832 5052 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523835 5052 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523837 5052 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523840 5052 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523842 5052 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523845 5052 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523849 5052 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523852 5052 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523885 5052 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523889 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523891 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523895 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523897 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523900 5052 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523903 5052 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523906 5052 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523909 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523912 5052 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523914 5052 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:10.528309 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523917 5052 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523919 5052 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523922 5052 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523925 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523928 5052 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523930 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523933 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523935 5052 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523938 5052 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523940 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523943 5052 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523945 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523958 5052 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523961 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523964 5052 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523966 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523969 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523971 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523974 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:10.528778 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523977 5052 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523980 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523982 5052 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523985 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523988 5052 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523991 5052 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523993 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523996 5052 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.523998 5052 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524001 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524004 5052 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524006 5052 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524009 5052 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524011 5052 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524014 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524018 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524021 5052 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524024 5052 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524026 5052 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524029 5052 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:10.529310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524032 5052 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524034 5052 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524037 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524039 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524042 5052 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524044 5052 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524146 5052 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524156 5052 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524166 5052 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524174 5052 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524179 5052 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524182 5052 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524187 5052 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524191 5052 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524194 5052 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524197 5052 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524201 5052 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524204 5052 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524207 5052 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524210 5052 flags.go:64] FLAG: --cgroup-root="" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524213 5052 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524216 5052 flags.go:64] FLAG: --client-ca-file="" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524219 5052 flags.go:64] FLAG: --cloud-provider="external" Oct 30 21:53:10.530117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524223 5052 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524227 5052 flags.go:64] FLAG: --cluster-domain="" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524230 5052 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524233 5052 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524237 5052 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524240 5052 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524244 5052 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524247 5052 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524250 5052 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524254 5052 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524257 5052 flags.go:64] FLAG: --contention-profiling="false" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524260 5052 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524263 5052 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524266 5052 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524270 5052 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524274 5052 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524278 5052 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524281 5052 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524285 5052 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524288 5052 flags.go:64] FLAG: --enable-server="true" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524291 5052 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524297 5052 flags.go:64] FLAG: --event-burst="100" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524300 5052 flags.go:64] FLAG: --event-qps="50" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524303 5052 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 21:53:10.530729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524307 5052 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524310 5052 flags.go:64] FLAG: --eviction-hard="" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524314 5052 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524317 5052 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524320 5052 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524323 5052 flags.go:64] FLAG: --eviction-soft="" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524327 5052 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524330 5052 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524332 5052 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524336 5052 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524339 5052 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524342 5052 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524345 5052 flags.go:64] FLAG: --feature-gates="" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524352 5052 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524355 5052 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524358 5052 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524361 5052 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524364 5052 flags.go:64] FLAG: --healthz-port="10248" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524367 5052 flags.go:64] FLAG: --help="false" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524370 5052 flags.go:64] FLAG: --hostname-override="ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524373 5052 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524377 5052 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524380 5052 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 21:53:10.531355 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524383 5052 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524387 5052 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524390 5052 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524397 5052 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524400 5052 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524403 5052 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524406 5052 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524409 5052 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524412 5052 flags.go:64] FLAG: --kube-reserved="" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524415 5052 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524418 5052 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524421 5052 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524424 5052 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524427 5052 flags.go:64] FLAG: --lock-file="" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524429 5052 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524432 5052 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524437 5052 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524442 5052 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524445 5052 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524449 5052 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524452 5052 flags.go:64] FLAG: --logging-format="text" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524455 5052 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524458 5052 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524461 5052 flags.go:64] FLAG: --manifest-url="" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524464 5052 flags.go:64] FLAG: --manifest-url-header="" Oct 30 21:53:10.531974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524469 5052 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524472 5052 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524476 5052 flags.go:64] FLAG: --max-pods="110" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524479 5052 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524482 5052 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524485 5052 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524488 5052 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524491 5052 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524494 5052 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524497 5052 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524505 5052 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524509 5052 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524512 5052 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524515 5052 flags.go:64] FLAG: --pod-cidr="" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524518 5052 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524521 5052 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524524 5052 flags.go:64] FLAG: --pods-per-core="0" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524527 5052 flags.go:64] FLAG: --port="10250" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524530 5052 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524534 5052 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-02a40299008fae476" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524537 5052 flags.go:64] FLAG: --qos-reserved="" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524540 5052 flags.go:64] FLAG: --read-only-port="10255" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524543 5052 flags.go:64] FLAG: --register-node="true" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524548 5052 flags.go:64] FLAG: --register-with-taints="" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524552 5052 flags.go:64] FLAG: --registry-burst="10" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524555 5052 flags.go:64] FLAG: --registry-qps="5" Oct 30 21:53:10.532571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524558 5052 flags.go:64] FLAG: --reserved-cpus="" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524562 5052 flags.go:64] FLAG: --reserved-memory="" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524566 5052 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524569 5052 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524572 5052 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524575 5052 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524578 5052 flags.go:64] FLAG: --runonce="false" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524581 5052 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524584 5052 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524587 5052 flags.go:64] FLAG: --seccomp-default="false" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524590 5052 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524593 5052 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524596 5052 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524599 5052 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524603 5052 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524606 5052 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524610 5052 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524613 5052 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524616 5052 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524619 5052 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524622 5052 flags.go:64] FLAG: --system-cgroups="" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524625 5052 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524630 5052 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524633 5052 flags.go:64] FLAG: --tls-cert-file="" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524636 5052 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 21:53:10.533326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524640 5052 flags.go:64] FLAG: --tls-min-version="" Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524642 5052 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524645 5052 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524648 5052 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524652 5052 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524656 5052 flags.go:64] FLAG: --v="2" Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524661 5052 flags.go:64] FLAG: --version="false" Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524665 5052 flags.go:64] FLAG: --vmodule="" Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524668 5052 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.524673 5052 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524809 5052 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524813 5052 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524816 5052 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524819 5052 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524822 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524825 5052 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524828 5052 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524831 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524833 5052 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524836 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524839 5052 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:10.533951 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524842 5052 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524845 5052 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524849 5052 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524852 5052 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524868 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524871 5052 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524874 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524878 5052 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524882 5052 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524886 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524889 5052 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524892 5052 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524895 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524897 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524900 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524904 5052 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524907 5052 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524909 5052 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524912 5052 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524915 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:10.534681 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524918 5052 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524921 5052 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524924 5052 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524926 5052 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524929 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524932 5052 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524934 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524938 5052 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524942 5052 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524945 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524948 5052 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524950 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524954 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524956 5052 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524960 5052 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524963 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524966 5052 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524968 5052 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524971 5052 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:10.535252 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524973 5052 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524976 5052 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524978 5052 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524981 5052 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524984 5052 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524986 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524989 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524991 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524995 5052 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.524998 5052 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525000 5052 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525003 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525006 5052 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525009 5052 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525011 5052 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525015 5052 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525017 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525020 5052 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525022 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525025 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:10.535797 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525028 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525031 5052 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525033 5052 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525035 5052 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525038 5052 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525041 5052 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525043 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525047 5052 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525049 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525052 5052 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525055 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525058 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525061 5052 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525063 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525066 5052 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525068 5052 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525071 5052 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525074 5052 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525076 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:10.536310 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525079 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525083 5052 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525085 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525088 5052 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525090 5052 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525093 5052 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525096 5052 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525098 5052 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525101 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525104 5052 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525106 5052 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525109 5052 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525112 5052 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525115 5052 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525117 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525120 5052 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:10.536781 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525122 5052 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.525148 5052 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525188 5052 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525192 5052 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525197 5052 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525200 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525203 5052 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525206 5052 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525209 5052 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525211 5052 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525214 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525217 5052 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525219 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525222 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525225 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525227 5052 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525230 5052 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:10.537250 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525233 5052 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525237 5052 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525239 5052 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525242 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525245 5052 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525247 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525250 5052 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525252 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525255 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525258 5052 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525261 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525263 5052 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525266 5052 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525268 5052 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525271 5052 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525274 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525276 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525279 5052 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525282 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:10.537669 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525285 5052 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525288 5052 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525291 5052 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525293 5052 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525296 5052 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525299 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525301 5052 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525304 5052 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525306 5052 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525309 5052 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525312 5052 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525314 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525317 5052 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525319 5052 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525323 5052 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525326 5052 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525329 5052 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525331 5052 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525334 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525336 5052 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:10.538216 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525339 5052 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525342 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525344 5052 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525347 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525350 5052 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525353 5052 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525356 5052 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525358 5052 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525361 5052 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525363 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525366 5052 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525369 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525374 5052 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525377 5052 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525381 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525383 5052 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525386 5052 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525389 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525391 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525394 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:10.538697 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525396 5052 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525399 5052 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525401 5052 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525404 5052 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525406 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525409 5052 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525415 5052 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525417 5052 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525420 5052 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525422 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525425 5052 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525428 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525432 5052 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525436 5052 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525439 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525442 5052 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525445 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525448 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525451 5052 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:10.539208 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525453 5052 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525456 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525459 5052 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525462 5052 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525464 5052 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525468 5052 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525471 5052 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525473 5052 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525476 5052 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525479 5052 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525481 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525484 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.525486 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.529128 5052 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.529216 5052 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.529244 5052 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.529250 5052 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529376 5052 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529648 5052 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:10.539659 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529652 5052 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529656 5052 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529659 5052 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529662 5052 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529665 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529668 5052 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529671 5052 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529674 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529677 5052 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529680 5052 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529683 5052 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529686 5052 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529695 5052 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529700 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529706 5052 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529710 5052 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529715 5052 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529720 5052 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529725 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:10.540126 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529729 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529737 5052 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529743 5052 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529748 5052 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529752 5052 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529764 5052 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529769 5052 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529774 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529779 5052 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529785 5052 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529790 5052 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529794 5052 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529799 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529804 5052 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529808 5052 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529813 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529817 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529822 5052 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529832 5052 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529836 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:10.540577 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529841 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529846 5052 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529850 5052 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529869 5052 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529874 5052 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529879 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529883 5052 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529888 5052 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529893 5052 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529898 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529902 5052 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529913 5052 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529917 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529921 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529928 5052 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529934 5052 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529939 5052 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529944 5052 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529949 5052 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:10.541080 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529953 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529958 5052 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529962 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529968 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529978 5052 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529983 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529988 5052 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529993 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.529998 5052 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530002 5052 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530007 5052 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530012 5052 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530017 5052 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530021 5052 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530025 5052 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530030 5052 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530039 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530044 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530048 5052 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:10.541554 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530053 5052 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530057 5052 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530062 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530066 5052 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530070 5052 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530076 5052 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530080 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530085 5052 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530089 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530094 5052 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530104 5052 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530108 5052 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530113 5052 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530117 5052 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530122 5052 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530126 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530131 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530137 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530141 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530146 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:10.542153 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530150 5052 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530154 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530158 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530169 5052 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530173 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530178 5052 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530182 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.530324 5052 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530613 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530624 5052 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530629 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530632 5052 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530637 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530641 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530644 5052 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530647 5052 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:10.542708 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530652 5052 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530655 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530657 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530660 5052 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530663 5052 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530665 5052 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530668 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530671 5052 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530673 5052 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530676 5052 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530678 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530681 5052 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530684 5052 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530686 5052 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530689 5052 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530692 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530695 5052 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530697 5052 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530700 5052 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530704 5052 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:10.543133 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530707 5052 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530710 5052 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530712 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530715 5052 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530718 5052 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530720 5052 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530723 5052 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530726 5052 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530729 5052 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530732 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530734 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530737 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530740 5052 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530743 5052 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530747 5052 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530749 5052 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530754 5052 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530758 5052 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530761 5052 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530765 5052 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:10.543616 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530768 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530771 5052 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530773 5052 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530776 5052 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530779 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530781 5052 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530784 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530787 5052 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530790 5052 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530792 5052 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530795 5052 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530806 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530809 5052 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530812 5052 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530815 5052 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530818 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530820 5052 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530823 5052 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530826 5052 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530829 5052 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:10.544177 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530831 5052 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530834 5052 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530836 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530839 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530842 5052 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530844 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530847 5052 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530850 5052 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530853 5052 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530871 5052 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530876 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530879 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530882 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530885 5052 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530888 5052 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530890 5052 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530893 5052 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530895 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530898 5052 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530901 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:10.544977 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530904 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530907 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530910 5052 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530913 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530915 5052 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530918 5052 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530921 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530923 5052 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530926 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530930 5052 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530933 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530936 5052 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530939 5052 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530942 5052 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530945 5052 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530947 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530950 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:10.545609 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.530952 5052 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:10.546348 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.530978 5052 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:53:10.546348 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531011 5052 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:10.546348 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531017 5052 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:10.546348 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531020 5052 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:10.546348 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531024 5052 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:10.546348 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531027 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:10.546348 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531029 5052 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:10.546348 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531032 5052 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:10.546348 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531035 5052 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:10.546348 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531038 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:10.546348 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531041 5052 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:10.546348 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531043 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:10.546348 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531046 5052 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:10.546348 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531049 5052 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:10.546348 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531052 5052 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531054 5052 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531057 5052 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531060 5052 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531062 5052 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531065 5052 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531067 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531070 5052 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531072 5052 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531075 5052 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531077 5052 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531080 5052 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531082 5052 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531085 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531088 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531090 5052 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531092 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531096 5052 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531099 5052 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531102 5052 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:10.546897 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531104 5052 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531106 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531109 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531112 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531114 5052 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531116 5052 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531119 5052 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531121 5052 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531124 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531127 5052 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531129 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531132 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531135 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531138 5052 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531141 5052 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531144 5052 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531147 5052 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531150 5052 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531153 5052 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:10.547535 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531155 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531159 5052 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531162 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531165 5052 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531167 5052 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531170 5052 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531173 5052 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531175 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531178 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531180 5052 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531183 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531186 5052 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531189 5052 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531192 5052 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531194 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531197 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531199 5052 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531202 5052 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531205 5052 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:10.548018 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531207 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531209 5052 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531212 5052 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531214 5052 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531217 5052 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531219 5052 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531222 5052 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531224 5052 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531227 5052 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531230 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531232 5052 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531234 5052 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531237 5052 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531239 5052 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531242 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531244 5052 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531247 5052 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531249 5052 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531252 5052 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531254 5052 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:10.548506 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531257 5052 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531259 5052 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531262 5052 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531264 5052 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531267 5052 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531273 5052 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531275 5052 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531278 5052 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531280 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531283 5052 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531286 5052 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531288 5052 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531292 5052 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531294 5052 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:10.531297 5052 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.531352 5052 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.532305 5052 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.532361 5052 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.532551 5052 server.go:1014] "Starting client certificate rotation" Oct 30 21:53:10.549020 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.532699 5052 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 21:53:10.549537 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.532771 5052 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:47:30 +0000 UTC" deadline="2028-08-05 01:00:38.556504976 +0000 UTC" Oct 30 21:53:10.549537 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.532820 5052 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15459h7m28.023689109s" Oct 30 21:53:10.549537 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.533028 5052 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 21:53:10.549537 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.534064 5052 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 21:53:10.549537 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.535160 5052 log.go:25] "Validated CRI v1 runtime API" Oct 30 21:53:10.549537 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.536844 5052 log.go:25] "Validated CRI v1 image API" Oct 30 21:53:10.549537 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.537557 5052 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 21:53:10.549537 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.539439 5052 fs.go:135] Filesystem UUIDs: map[618ee822-2135-4fc3-b713-192526808c00:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ca09a766-1c6f-481b-a027-6c94c1b6df43:/dev/nvme0n1p4] Oct 30 21:53:10.549823 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.539459 5052 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0533de5ce33c93f1a7d2aa0f2ab6c42fa530f57d6b8738521c09b572d19803bf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0533de5ce33c93f1a7d2aa0f2ab6c42fa530f57d6b8738521c09b572d19803bf/userdata/shm major:0 minor:340 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0b3172c12fe0cb80cb0ba689d2dc46ebb3add53f9f68ecb66db1e0f3c7e8f35f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0b3172c12fe0cb80cb0ba689d2dc46ebb3add53f9f68ecb66db1e0f3c7e8f35f/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0ca0363e3b421603ecee03e9d872eb681f1d3f7d3d000ee7d5277ece7cb0303e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0ca0363e3b421603ecee03e9d872eb681f1d3f7d3d000ee7d5277ece7cb0303e/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/20fc85f8d6d291e0d7f776ff749acf65625502e219981cdde576c389c75bfc37/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/20fc85f8d6d291e0d7f776ff749acf65625502e219981cdde576c389c75bfc37/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2180bd7afa382e181f34312015a13a50ee178d4a05a7191f969d0a9cf7cba3d1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2180bd7afa382e181f34312015a13a50ee178d4a05a7191f969d0a9cf7cba3d1/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/23ffbb0199c49cd7832a36265d949f8d61fcbdcdc706226d93000220888736a3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/23ffbb0199c49cd7832a36265d949f8d61fcbdcdc706226d93000220888736a3/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/258c752a743a933baca8466330ce2843b48d7ca189e06e0cd17bc2ee5758d076/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/258c752a743a933baca8466330ce2843b48d7ca189e06e0cd17bc2ee5758d076/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/31528da19706fb78f14c82ffd1636a2adc80c2bf42a4d83c7c0367c9018690b9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/31528da19706fb78f14c82ffd1636a2adc80c2bf42a4d83c7c0367c9018690b9/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4f1962aba89c60bbaaa40d51984227be2d7bcd018f94d2232a5f4dad4ad4aed4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4f1962aba89c60bbaaa40d51984227be2d7bcd018f94d2232a5f4dad4ad4aed4/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/641f8c09540ad835e92bc47bca6b3986d7f12a7de44f314ba47c7ecd3c8ffec0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/641f8c09540ad835e92bc47bca6b3986d7f12a7de44f314ba47c7ecd3c8ffec0/userdata/shm major:0 minor:243 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6fa054a325b204e164a5e95c241ad49d48bad65ad4a437b14a2466a6819a2dff/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6fa054a325b204e164a5e95c241ad49d48bad65ad4a437b14a2466a6819a2dff/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/75c168f1e94c8dd3d0c1196e9fba99847b5fb8f5eaeca5410cc43ca5c246e956/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/75c168f1e94c8dd3d0c1196e9fba99847b5fb8f5eaeca5410cc43ca5c246e956/userdata/shm major:0 minor:337 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/91bfb21752db6aabeb4d104750f48bbe268e6dc56df1f80dfb7a6dd4afe52f94/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/91bfb21752db6aabeb4d104750f48bbe268e6dc56df1f80dfb7a6dd4afe52f94/userdata/shm major:0 minor:349 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/99ad65df73e8ab151bd1ae509436872b6172b7d85a2f99c8999471bd8ebcf325/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/99ad65df73e8ab151bd1ae509436872b6172b7d85a2f99c8999471bd8ebcf325/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9a39dd8b961fd22403f9e2c2b627062c216c0b0691f62c971e2510f2c01c28a9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9a39dd8b961fd22403f9e2c2b627062c216c0b0691f62c971e2510f2c01c28a9/userdata/shm major:0 minor:304 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9b42edc552da2d58e4dbec3399315ee170c341c813d4b0eb68817188ace05c45/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9b42edc552da2d58e4dbec3399315ee170c341c813d4b0eb68817188ace05c45/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b61a0e2e382177458b759f1f9b6113c77e16287ead5e9551e7e52381aa5f9096/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b61a0e2e382177458b759f1f9b6113c77e16287ead5e9551e7e52381aa5f9096/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b768c924fe8c63ff64c8c0a2bbfab7318b150e36a32df1d3e854514bc34ea901/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b768c924fe8c63ff64c8c0a2bbfab7318b150e36a32df1d3e854514bc34ea901/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b89797fb1466c0ee0622a78b38151e3b12fdfa98edb0823a9045d8d03d3e1169/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b89797fb1466c0ee0622a78b38151e3b12fdfa98edb0823a9045d8d03d3e1169/userdata/shm major:0 minor:241 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bb05a8002385ca2c83912d89a0e310ae5ad9ce143cce5629f9ecd78f5fdcd687/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bb05a8002385ca2c83912d89a0e310ae5ad9ce143cce5629f9ecd78f5fdcd687/userdata/shm major:0 minor:335 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c8c5de1d9c32247911a979df12937d30ad8c5df8374bc2c33fecec98e7c207b0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c8c5de1d9c32247911a979df12937d30ad8c5df8374bc2c33fecec98e7c207b0/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cb7dda04a39fa37758507df57f0dc9002834e781ef8e334502efac6fe71b00ad/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cb7dda04a39fa37758507df57f0dc9002834e781ef8e334502efac6fe71b00ad/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cc67bb738cf00008f91ff3c92a67d0dd44cbf445e7f6fa28fd011cce39044001/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cc67bb738cf00008f91ff3c92a67d0dd44cbf445e7f6fa28fd011cce39044001/userdata/shm major:0 minor:81 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dea68d5e3936f78b0a9c72e98e3622718670f36cd81f20f2e6c5b8d393d69303/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dea68d5e3936f78b0a9c72e98e3622718670f36cd81f20f2e6c5b8d393d69303/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f106cd5ffedf78915300e63a93f390a641a0dc289f673bf9730811dd00b89bce/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f106cd5ffedf78915300e63a93f390a641a0dc289f673bf9730811dd00b89bce/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fc430f158552530ba6401eac6341dd6f783809e5b1127af5442004c5ebfeb4de/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fc430f158552530ba6401eac6341dd6f783809e5b1127af5442004c5ebfeb4de/userdata/shm major:0 minor:97 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/012b8527-ec34-4639-b76c-5f941b31d02d/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/012b8527-ec34-4639-b76c-5f941b31d02d/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/012b8527-ec34-4639-b76c-5f941b31d02d/volumes/kubernetes.io~projected/kube-api-access-k6pqj:{mountpoint:/var/lib/kubelet/pods/012b8527-ec34-4639-b76c-5f941b31d02d/volumes/kubernetes.io~projected/kube-api-access-k6pqj major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/012b8527-ec34-4639-b76c-5f941b31d02d/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/012b8527-ec34-4639-b76c-5f941b31d02d/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/012b8527-ec34-4639-b76c-5f941b31d02d/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/012b8527-ec34-4639-b76c-5f941b31d02d/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/181f4022-4f53-4e23-8424-01f6b5e06ec6/volumes/kubernetes.io~projected/kube-api-access-x9cqn:{mountpoint:/var/lib/kubelet/pods/181f4022-4f53-4e23-8424-01f6b5e06ec6/volumes/kubernetes.io~projected/kube-api-access-x9cqn major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/181f4022-4f53-4e23-8424-01f6b5e06ec6/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/181f4022-4f53-4e23-8424-01f6b5e06ec6/volumes/kubernetes.io~secret/cert major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/187603a7-5181-4c01-b7d2-3d7a56796255/volumes/kubernetes.io~projected/kube-api-access-m25k7:{mountpoint:/var/lib/kubelet/pods/187603a7-5181-4c01-b7d2-3d7a56796255/volumes/kubernetes.io~projected/kube-api-access-m25k7 major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3444842c-2f38-409f-ba87-e21af956df52/volumes/kubernetes.io~projected/kube-api-access-z22xr:{mountpoint:/var/lib/kubelet/pods/3444842c-2f38-409f-ba87-e21af956df52/volumes/kubernetes.io~projected/kube-api-access-z22xr major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3cfcee7d-4a08-441e-874b-5486b381d0f2/volumes/kubernetes.io~projected/kube-api-access-bb8pz:{mountpoint:/var/lib/kubelet/pods/3cfcee7d-4a08-441e-874b-5486b381d0f2/volumes/kubernetes.io~projected/kube-api-access-bb8pz major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3cfcee7d-4a08-441e-874b-5486b381d0f2/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/3cfcee7d-4a08-441e-874b-5486b381d0f2/volumes/kubernetes.io~secret/serving-cert major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3d901cac-9d8d-48f8-b1a6-61ae43d46721/volumes/kubernetes.io~projected/kube-api-access-q9ln7:{mountpoint:/var/lib/kubelet/pods/3d901cac-9d8d-48f8-b1a6-61ae43d46721/volumes/kubernetes.io~projected/kube-api-access-q9ln7 major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b/volumes/kubernetes.io~projected/kube-api-access-vf456:{mountpoint:/var/lib/kubelet/pods/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b/volumes/kubernetes.io~projected/kube-api-access-vf456 major:0 minor:343 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b/volumes/kubernetes.io~secret/signing-key major:0 minor:342 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4846560b-5370-4fa1-8d36-43dfc4011191/volumes/kubernetes.io~projected/kube-api-access-w5g2m:{mountpoint:/var/lib/kubelet/pods/4846560b-5370-4fa1-8d36-43dfc4011191/volumes/kubernetes.io~projected/kube-api-access-w5g2m major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4873d347-3f18-4861-986e-15785bfd25c3/volumes/kubernetes.io~projected/kube-api-access-j794x:{mountpoint:/var/lib/kubelet/pods/4873d347-3f18-4861-986e-15785bfd25c3/volumes/kubernetes.io~projected/kube-api-access-j794x major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1/volumes/kubernetes.io~projected/kube-api-access-jl2sc:{mountpoint:/var/lib/kubelet/pods/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1/volumes/kubernetes.io~projected/kube-api-access-jl2sc major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/57645c9d-50be-44cf-8ae7-c0c3103b2a78/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/57645c9d-50be-44cf-8ae7-c0c3103b2a78/volumes/kubernetes.io~secret/agent-certs major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6f371722-dc8f-48eb-8f8c-28f394ef4360/volumes/kubernetes.io~projected/kube-api-access-984vh:{mountpoint:/var/lib/kubelet/pods/6f371722-dc8f-48eb-8f8c-28f394ef4360/volumes/kubernetes.io~projected/kube-api-access-984vh major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/754f74c1-4a21-4497-bdb6-9b8b1e97842a/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/754f74c1-4a21-4497-bdb6-9b8b1e97842a/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/754f74c1-4a21-4497-bdb6-9b8b1e97842a/volumes/kubernetes.io~projected/kube-api-access-2xcw4:{mountpoint:/var/lib/kubelet/pods/754f74c1-4a21-4497-bdb6-9b8b1e97842a/volumes/kubernetes.io~projected/kube-api-access-2xcw4 major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/754f74c1-4a21-4497-bdb6-9b8b1e97842a/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/754f74c1-4a21-4497-bdb6-9b8b1e97842a/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7c068922-cad3-472a-a20a-890955ecb231/volumes/kubernetes.io~projected/kube-api-access-vvj8c:{mountpoint:/var/lib/kubelet/pods/7c068922-cad3-472a-a20a-890955ecb231/volumes/kubernetes.io~projected/kube-api-access-vvj8c major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7c068922-cad3-472a-a20a-890955ecb231/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/7c068922-cad3-472a-a20a-890955ecb231/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7f473fc1-7e45-4581-9426-009af0a1682b/volumes/kubernetes.io~projected/kube-api-access-tskrq:{mountpoint:/var/lib/kubelet/pods/7f473fc1-7e45-4581-9426-009af0a1682b/volumes/kubernetes.io~projected/kube-api-access-tskrq major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8328c2d0-1c49-4619-8ccc-4a238ce29121/volumes/kubernetes.io~projected/kube-api-access-pps4d:{mountpoint:/var/lib/kubelet/pods/8328c2d0-1c49-4619-8ccc-4a238ce29121/volumes/kubernetes.io~projected/kube-api-access-pps4d major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/88107d0e-6b47-4320-8647-2a597f418bf4/volumes/kubernetes.io~projected/kube-api-access-gr8d5:{mountpoint:/var/lib/kubelet/pods/88107d0e-6b47-4320-8647-2a597f418bf4/volumes/kubernetes.io~projected/kube-api-access-gr8d5 major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/88107d0e-6b47-4320-8647-2a597f418bf4/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/88107d0e-6b47-4320-8647-2a597f418bf4/volumes/kubernetes.io~secret/serving-cert major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9101efec-ec15-4f30-929d-a3bcfd851caa/volumes/kubernetes.io~projected/kube-api-access-9dqrt:{mountpoint:/var/lib/kubelet/pods/9101efec-ec15-4f30-929d-a3bcfd851caa/volumes/kubernetes.io~projected/kube-api-access-9dqrt major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/937459e4-a573-4d05-980b-b8c42db410f3/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/937459e4-a573-4d05-980b-b8c42db410f3/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/937459e4-a573-4d05-980b-b8c42db410f3/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/937459e4-a573-4d05-980b-b8c42db410f3/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/937459e4-a573-4d05-980b-b8c42db410f3/volumes/kubernetes.io~projected/kube-api-access-bmdvf:{mountpoint:/var/lib/kubelet/pods/937459e4-a573-4d05-980b-b8c42db410f3/volumes/kubernetes.io~projected/kube-api-access-bmdvf major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/967b7974-ef9d-4eff-8265-879c05e6fc96/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/967b7974-ef9d-4eff-8265-879c05e6fc96/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9ca45dcf-d2cd-4797-be23-47d5ac33b57b/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/9ca45dcf-d2cd-4797-be23-47d5ac33b57b/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9ca45dcf-d2cd-4797-be23-47d5ac33b57b/volumes/kubernetes.io~projected/kube-api-access-vcwnh:{mountpoint:/var/lib/kubelet/pods/9ca45dcf-d2cd-4797-be23-47d5ac33b57b/volumes/kubernetes.io~projected/kube-api-access-vcwnh major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9ca45dcf-d2cd-4797-be23-47d5ac33b57b/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/9ca45dcf-d2cd-4797-be23-47d5ac33b57b/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9ca45dcf-d2cd-4797-be23-47d5ac33b57b/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/9ca45dcf-d2cd-4797-be23-47d5ac33b57b/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4646859-cf39-4d6b-a2e2-f2795635390c/volumes/kubernetes.io~projected/kube-api-access-bd77j:{mountpoint:/var/lib/kubelet/pods/a4646859-cf39-4d6b-a2e2-f2795635390c/volumes/kubernetes.io~projected/kube-api-access-bd77j major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4646859-cf39-4d6b-a2e2-f2795635390c/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/a4646859-cf39-4d6b-a2e2-f2795635390c/volumes/kubernetes.io~secret/serving-cert major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93/volumes/kubernetes.io~projected/kube-api-access-9mv6g:{mountpoint:/var/lib/kubelet/pods/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93/volumes/kubernetes.io~projected/kube-api-access-9mv6g major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c41902e8-bf12-4ecc-a6e1-b87582b20f86/volumes/kubernetes.io~projected/kube-api-access-4gzr6:{mountpoint:/var/lib/kubelet/pods/c41902e8-bf12-4ecc-a6e1-b87582b20f86/volumes/kubernetes.io~projected/kube-api-access-4gzr6 major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b/volumes/kubernetes.io~projected/kube-api-access-zgp75:{mountpoint:/var/lib/kubelet/pods/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b/volumes/kubernetes.io~projected/kube-api-access-zgp75 major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c7c738de-1f94-4fb0-a389-84512dcb22b9/volumes/kubernetes.io~projected/kube-api-access-wcnlq:{mountpoint:/var/lib/kubelet/pods/c7c738de-1f94-4fb0-a389-84512dcb22b9/volumes/kubernetes.io~projected/kube-api-access-wcnlq major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc3ee40a-be4e-476f-91ff-a0cd164812fc/volumes/kubernetes.io~projected/kube-api-access-2lx28:{mountpoint:/var/lib/kubelet/pods/cc3ee40a-be4e-476f-91ff-a0cd164812fc/volumes/kubernetes.io~projected/kube-api-access-2lx28 major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc3ee40a-be4e-476f-91ff-a0cd164812fc/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/cc3ee40a-be4e-476f-91ff-a0cd164812fc/volumes/kubernetes.io~secret/default-certificate major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc3ee40a-be4e-476f-91ff-a0cd164812fc/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/cc3ee40a-be4e-476f-91ff-a0cd164812fc/volumes/kubernetes.io~secret/stats-auth major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cfb5127e-d35c-4d71-9565-b8044e41f2bc/volumes/kubernetes.io~projected/kube-api-access-sx6dh:{mountpoint:/var/lib/kubelet/pods/cfb5127e-d35c-4d71-9565-b8044e41f2bc/volumes/kubernetes.io~projected/kube-api-access-sx6dh major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1/volumes/kubernetes.io~projected/kube-api-access-62fhs:{mountpoint:/var/lib/kubelet/pods/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1/volumes/kubernetes.io~projected/kube-api-access-62fhs major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/daafa095-7904-4d87-ad51-83577c6d1452/volumes/kubernetes.io~projected/kube-api-access-87f7c:{mountpoint:/var/lib/kubelet/pods/daafa095-7904-4d87-ad51-83577c6d1452/volumes/kubernetes.io~projected/kube-api-access-87f7c major:0 minor:324 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a/volumes/kubernetes.io~projected/kube-api-access-s8rqr:{mountpoint:/var/lib/kubelet/pods/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a/volumes/kubernetes.io~projected/kube-api-access-s8rqr major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e23d7533-e36d-460f-b8f4-18d4f38dd0e7/volumes/kubernetes.io~projected/kube-api-access-vt255:{mountpoint:/var/lib/kubelet/pods/e23d7533-e36d-460f-b8f4-18d4f38dd0e7/volumes/kubernetes.io~projected/kube-api-access-vt255 major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f2746830-9846-4bb6-afc2-713e6a5cd2e8/volumes/kubernetes.io~projected/kube-api-access-8c7wj:{mountpoint:/var/lib/kubelet/pods/f2746830-9846-4bb6-afc2-713e6a5cd2e8/volumes/kubernetes.io~projected/kube-api-access-8c7wj major:0 minor:339 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/f817c6bf24319f22cf37b394081d0ef707808302c8f547bc8b62592fed5ae9b2/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/2f1bb5eb71d9794ef43087823adfdf32f544a9fc1e0383e8a8520bb548715cb4/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/08e97f663e1d441d72a5b6d366ba8cd1dd56bce1be7c06f1c7acd59f3f804de1/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/4169ba40f80f40c3e7f2df0b4a9f83646cc44da058e90ceffef4b0a083529069/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/f493323cd40b2efacbda279700c29e371fa86389bfb7856c615bbe9c2e816487/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/4d15ed8ea1e16d3df87e2e51076bfd0af15b253e34bec74d33e6c1eb22e8fc16/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/f6e0788ec9f9874226deadbe4fe572d742b6e3d1507f0868e865e46c99f0ddf2/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/acb3fa946d2f84d4e019e9ee9d653c84a1a4adc7b25e32c1f8a637d67d35588a/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/792c28427e0055a464d2c10f0490d7c5cfec44cf8d14e3307a231482694edf2b/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/07f89db7b0bb2950eb0312bcf464ac3377779f21af8302d8e582c883ffe6dd00/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-138:{mountpoint:/var/lib/containers/storage/overlay/e742ff8ca2d4e4f74599e4bec268a62c0d12e3503118bb7d0d35890bb4369319/merged major:0 minor:138 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/a3cbe1360385be220721adef2957d4844c64c4cc5da5b63f3aaf16c2122d9542/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/da816789a7a059b4dc4cc1406acb9c67c2281810c237e3bd11c52c9868002bcc/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/3c2092c35def01f374db0e7b40657ed80ef9a8f06dee32dc229b0c0064a64a5a/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/a42e98acd70649abe1004539c73d2cd4862989e5ed99d3802f26a2dcd9917466/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/60e3fd4c3e19381a75cafe2879c08c808eda742cfe5be1083d233232118f6d0b/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/1340eccb905055d4bbb3b584bf1c46ec37fd7cd871e23e9312b008d948cba222/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/9b64e0f636b57ae755ca98deba95902a75dd1265b4557d77e6de75cb497f91f3/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/d7bd3d1ba9d15b57ab0371cba97f692cdef5c74f3134215c0c66d66233fd2101/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/203bafee740c65fe24aff672912e580cca8e9d62cbb096c1722fef378c81db88/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/27d81586086f90cf17b23a01d5d16bece1bc676ff9aa9429ba577c11c0233d0b/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/54614315b2b41471c20600351f092050a68703144bc6fc7d47f0bbebdadcb02a/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/9db636a7751fd4d14cdc883a3d62a4e21a6cc8341678479aff25ad0931bcff69/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/29f061946fe262d308acbb56ccf7cb18c2dd6986f355cdc27ade056041bf480d/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/a604d8321e781f5c3fb30e728e4babc79af9c6fff67c5007fb6518df93a0886d/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/84218b0bd156019eccd8fd0d352220ed4a6be881c27e1ade75ab3dc540fa5e52/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/d38eea00717ef3b7fbb91f3fd5d7227a02971b8a89658d4cbd350f022bb80f16/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/04dbdb10eee115fcbbbd00f8d8a2ce5a2ee54b9274a7d07c38e516a4974a4cc0/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/5f04bfa8251a06f899972246b1283f6462266832652323a85a47515da2ef1a85/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/140397a16fdcd00edd1e8d8c3b7b905bfbfbab448711a2a54b8146c98dca05f6/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-274:{mountpoint:/var/lib/containers/storage/overlay/d43c82fea82c70eb2fb6f13b0c7d1e0a871d9bc4215b62549b29148ea1526864/merged major:0 minor:274 fsType:overlay blockSize:0} overlay_0-276:{mountpoint:/var/lib/containers/storage/overlay/1965bca4417ab8de3f1f7f09e54e570d3a9dc1c043d33f9e1ad98abef4bc36c4/merged major:0 minor:276 fsType:overlay blockSize:0} overlay_0-281:{mountpoint:/var/lib/containers/storage/overlay/5f05fa5e62b8cac0fc4eccfe3b757ba9bef510c16c1d3b8a2a716a06ae61b132/merged major:0 minor:281 fsType:overlay blockSize:0} overlay_0-283:{mountpoint:/var/lib/containers/storage/overlay/afc2620ca595bd2d94a2d53d6c61bfc27e4c6cd8c1af421a3e37258fa5087c5f/merged major:0 minor:283 fsType:overlay blockSize:0} overlay_0-285:{mountpoint:/var/lib/containers/storage/overlay/525cf708688a2deb7569a55a67bd6c51b4a4f944d99adabc5380c3ca56b40156/merged major:0 minor:285 fsType:overlay blockSize:0} overlay_0-296:{mountpoint:/var/lib/containers/storage/overlay/ddca5e3a1d18c4d8200d8bda74f3a2dffa431f9f8e06ba02dc846f5ed0948f30/merged major:0 minor:296 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/ff4954a16f1d01b8880c5fde482adc3ff994fdd18135960d35c97952a99979df/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/defb6ebd2040072549d0981505c3e123d21846912dc673779ed6e9fee28a47a9/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/74775878dd9c3ce78a84d5fdee67c145c59c5be638d269171142a644038e98e5/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-318:{mountpoint:/var/lib/containers/storage/overlay/49b45501737d346c9cf3be75482a6a20d29fc5735c900a1b93344a5483971433/merged major:0 minor:318 fsType:overlay blockSize:0} overlay_0-320:{mountpoint:/var/lib/containers/storage/overlay/9bc8a039f9d6a71817247b4501666e88fd092d77211b3da33e3f1752be0eac15/merged major:0 minor:320 fsType:overlay blockSize:0} overlay_0-322:{mountpoint:/var/lib/containers/storage/overlay/91c3dafdd1dd6164e1f6c1bf3420bfba7db7494130852d6ea874d69d010d909b/merged major:0 minor:322 fsType:overlay blockSize:0} overlay_0-344:{mountpoint:/var/lib/containers/storage/overlay/0a8f83bce54b61229d95981de4ccb7aac97f7fdc55afdab7fa8db8f57e2228d2/merged major:0 minor:344 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/b794c30be2d817ce895b005031d49a8138a685403b0009c42ed802d1bb72b78c/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/f025c065fb0f0bd275b9de1f74e28f179962d806cf8e9bb1ceed65bb175d136e/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/224a5cd51c3c207c0136895dc90524103d05996db746e5ae910328a74459335f/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/8687d3046318c898879d06a91531b8b581a9eb0a5ac2468abb7bf5f320d46977/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-356:{mountpoint:/var/lib/containers/storage/overlay/48c15b2b146cd787d139d65aa5360850d7950111d43ec89d297d5b680c822e10/merged major:0 minor:356 fsType:overlay blockSize:0} overlay_0-366:{mountpoint:/var/lib/containers/storage/overlay/bcc5e098fef6531c7aab1da2940467c2be9dcfa52271439ebb9da04ee88312e8/merged major:0 minor:366 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/aecb6bcc7a58893ef9f1ad03c5f2a420b96d0002066820d93124e6aef07d0fc3/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/29e2154005519389920ef772a70f7e936c6b9064f46d95ba5daa573ede5888dd/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-376:{mountpoint:/var/lib/containers/storage/overlay/63596a82d26798f6b92038cec5a1846a473941d5dbd3be888517c6d94d07000e/merged major:0 minor:376 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/ee77adfdb0392d4c8f904c3c98d9375f52c7a88780878866973d2eb3f3017765/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/72df8d65a5ec631843b683a320d4db3f633d62503b2a5cc7007e0be1a5ce9a60/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/8a0428536836b23d1080cb0187444621bb2f7a0f8245b68a70b627046fe819d7/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/044409c3d28138a158394ef19c758b1f0abe6c0962fb066b8e4a8341fd67908f/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/9ada8c7b4edb8cbb03ff9ab62658b05ba27126ae3be23f3510ebc66d10f76698/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/b7a02b663cf6d35c46a809cd1fc707b0ae7a02dcfb7b4fc53cc6fa749b4169d1/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/54116566128d2e26b2bb6f0ffef73cfb70122120ce15009193b36f96467addee/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/5fa139ded3bbd9243db74be6938f66d6c26dafecf122c13838a7000105f79b18/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/43e76c859b67ac31453401f407ef843a3950710a37eeeb02c56d35c379761012/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/6613af743b8f1e5e2fe597c47c74d223bc3432e9878ef9f1a463d90982176cda/merged major:0 minor:96 fsType:overlay blockSize:0}] Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.547789 5052 manager.go:217] Machine: {Timestamp:2026-10-30 21:53:10.547340066 +0000 UTC m=+0.070380790 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100019 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23fc9c1f8b0f17a852ef6cf4db2327 SystemUUID:ec23fc9c-1f8b-0f17-a852-ef6cf4db2327 BootID:d61bd31f-9111-4cda-9f26-c5f479f6c94a Filesystems:[{Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fc430f158552530ba6401eac6341dd6f783809e5b1127af5442004c5ebfeb4de/userdata/shm DeviceMajor:0 DeviceMinor:97 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a4646859-cf39-4d6b-a2e2-f2795635390c/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:207 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/57645c9d-50be-44cf-8ae7-c0c3103b2a78/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:67 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/daafa095-7904-4d87-ad51-83577c6d1452/volumes/kubernetes.io~projected/kube-api-access-87f7c DeviceMajor:0 DeviceMinor:324 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9101efec-ec15-4f30-929d-a3bcfd851caa/volumes/kubernetes.io~projected/kube-api-access-9dqrt DeviceMajor:0 DeviceMinor:333 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-138 DeviceMajor:0 DeviceMinor:138 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cc3ee40a-be4e-476f-91ff-a0cd164812fc/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:45 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9ca45dcf-d2cd-4797-be23-47d5ac33b57b/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:219 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/99ad65df73e8ab151bd1ae509436872b6172b7d85a2f99c8999471bd8ebcf325/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-356 DeviceMajor:0 DeviceMinor:356 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9ca45dcf-d2cd-4797-be23-47d5ac33b57b/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:205 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/754f74c1-4a21-4497-bdb6-9b8b1e97842a/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:57 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/e23d7533-e36d-460f-b8f4-18d4f38dd0e7/volumes/kubernetes.io~projected/kube-api-access-vt255 DeviceMajor:0 DeviceMinor:63 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/012b8527-ec34-4639-b76c-5f941b31d02d/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:222 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9b42edc552da2d58e4dbec3399315ee170c341c813d4b0eb68817188ace05c45/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-283 DeviceMajor:0 DeviceMinor:283 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7c068922-cad3-472a-a20a-890955ecb231/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-285 DeviceMajor:0 DeviceMinor:285 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-366 DeviceMajor:0 DeviceMinor:366 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/20fc85f8d6d291e0d7f776ff749acf65625502e219981cdde576c389c75bfc37/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3cfcee7d-4a08-441e-874b-5486b381d0f2/volumes/kubernetes.io~projected/kube-api-access-bb8pz DeviceMajor:0 DeviceMinor:210 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/754f74c1-4a21-4497-bdb6-9b8b1e97842a/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/012b8527-ec34-4639-b76c-5f941b31d02d/volumes/kubernetes.io~projected/kube-api-access-k6pqj DeviceMajor:0 DeviceMinor:221 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/75c168f1e94c8dd3d0c1196e9fba99847b5fb8f5eaeca5410cc43ca5c246e956/userdata/shm DeviceMajor:0 DeviceMinor:337 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b61a0e2e382177458b759f1f9b6113c77e16287ead5e9551e7e52381aa5f9096/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/937459e4-a573-4d05-980b-b8c42db410f3/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1/volumes/kubernetes.io~projected/kube-api-access-62fhs DeviceMajor:0 DeviceMinor:64 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/88107d0e-6b47-4320-8647-2a597f418bf4/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:202 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c7c738de-1f94-4fb0-a389-84512dcb22b9/volumes/kubernetes.io~projected/kube-api-access-wcnlq DeviceMajor:0 DeviceMinor:215 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-318 DeviceMajor:0 DeviceMinor:318 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-376 DeviceMajor:0 DeviceMinor:376 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9a39dd8b961fd22403f9e2c2b627062c216c0b0691f62c971e2510f2c01c28a9/userdata/shm DeviceMajor:0 DeviceMinor:304 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-344 DeviceMajor:0 DeviceMinor:344 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/cfb5127e-d35c-4d71-9565-b8044e41f2bc/volumes/kubernetes.io~projected/kube-api-access-sx6dh DeviceMajor:0 DeviceMinor:58 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:342 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/937459e4-a573-4d05-980b-b8c42db410f3/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/31528da19706fb78f14c82ffd1636a2adc80c2bf42a4d83c7c0367c9018690b9/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b89797fb1466c0ee0622a78b38151e3b12fdfa98edb0823a9045d8d03d3e1169/userdata/shm DeviceMajor:0 DeviceMinor:241 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b768c924fe8c63ff64c8c0a2bbfab7318b150e36a32df1d3e854514bc34ea901/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/967b7974-ef9d-4eff-8265-879c05e6fc96/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:288 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bb05a8002385ca2c83912d89a0e310ae5ad9ce143cce5629f9ecd78f5fdcd687/userdata/shm DeviceMajor:0 DeviceMinor:335 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/91bfb21752db6aabeb4d104750f48bbe268e6dc56df1f80dfb7a6dd4afe52f94/userdata/shm DeviceMajor:0 DeviceMinor:349 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/754f74c1-4a21-4497-bdb6-9b8b1e97842a/volumes/kubernetes.io~projected/kube-api-access-2xcw4 DeviceMajor:0 DeviceMinor:66 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b/volumes/kubernetes.io~projected/kube-api-access-vf456 DeviceMajor:0 DeviceMinor:343 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cc67bb738cf00008f91ff3c92a67d0dd44cbf445e7f6fa28fd011cce39044001/userdata/shm DeviceMajor:0 DeviceMinor:81 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/4846560b-5370-4fa1-8d36-43dfc4011191/volumes/kubernetes.io~projected/kube-api-access-w5g2m DeviceMajor:0 DeviceMinor:224 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-320 DeviceMajor:0 DeviceMinor:320 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cc3ee40a-be4e-476f-91ff-a0cd164812fc/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:206 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/181f4022-4f53-4e23-8424-01f6b5e06ec6/volumes/kubernetes.io~projected/kube-api-access-x9cqn DeviceMajor:0 DeviceMinor:214 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f2746830-9846-4bb6-afc2-713e6a5cd2e8/volumes/kubernetes.io~projected/kube-api-access-8c7wj DeviceMajor:0 DeviceMinor:339 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/181f4022-4f53-4e23-8424-01f6b5e06ec6/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:204 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9ca45dcf-d2cd-4797-be23-47d5ac33b57b/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:209 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/a4646859-cf39-4d6b-a2e2-f2795635390c/volumes/kubernetes.io~projected/kube-api-access-bd77j DeviceMajor:0 DeviceMinor:213 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/3d901cac-9d8d-48f8-b1a6-61ae43d46721/volumes/kubernetes.io~projected/kube-api-access-q9ln7 DeviceMajor:0 DeviceMinor:218 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-281 DeviceMajor:0 DeviceMinor:281 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1/volumes/kubernetes.io~projected/kube-api-access-jl2sc DeviceMajor:0 DeviceMinor:62 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/012b8527-ec34-4639-b76c-5f941b31d02d/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:197 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/012b8527-ec34-4639-b76c-5f941b31d02d/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:201 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/cc3ee40a-be4e-476f-91ff-a0cd164812fc/volumes/kubernetes.io~projected/kube-api-access-2lx28 DeviceMajor:0 DeviceMinor:225 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/641f8c09540ad835e92bc47bca6b3986d7f12a7de44f314ba47c7ecd3c8ffec0/userdata/shm DeviceMajor:0 DeviceMinor:243 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c8c5de1d9c32247911a979df12937d30ad8c5df8374bc2c33fecec98e7c207b0/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/88107d0e-6b47-4320-8647-2a597f418bf4/volumes/kubernetes.io~projected/kube-api-access-gr8d5 DeviceMajor:0 DeviceMinor:226 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-274 DeviceMajor:0 DeviceMinor:274 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93/volumes/kubernetes.io~projected/kube-api-access-9mv6g DeviceMajor:0 DeviceMinor:65 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2180bd7afa382e181f34312015a13a50ee178d4a05a7191f969d0a9cf7cba3d1/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9ca45dcf-d2cd-4797-be23-47d5ac33b57b/volumes/kubernetes.io~projected/kube-api-access-vcwnh DeviceMajor:0 DeviceMinor:227 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-296 DeviceMajor:0 DeviceMinor:296 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-322 DeviceMajor:0 DeviceMinor:322 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3444842c-2f38-409f-ba87-e21af956df52/volumes/kubernetes.io~projected/kube-api-access-z22xr DeviceMajor:0 DeviceMinor:217 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c41902e8-bf12-4ecc-a6e1-b87582b20f86/volumes/kubernetes.io~projected/kube-api-access-4gzr6 DeviceMajor:0 DeviceMinor:223 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/187603a7-5181-4c01-b7d2-3d7a56796255/volumes/kubernetes.io~projected/kube-api-access-m25k7 DeviceMajor:0 DeviceMinor:334 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/258c752a743a933baca8466330ce2843b48d7ca189e06e0cd17bc2ee5758d076/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/6f371722-dc8f-48eb-8f8c-28f394ef4360/volumes/kubernetes.io~projected/kube-api-access-984vh DeviceMajor:0 DeviceMinor:211 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-276 DeviceMajor:0 DeviceMinor:276 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0ca0363e3b421603ecee03e9d872eb681f1d3f7d3d000ee7d5277ece7cb0303e/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7f473fc1-7e45-4581-9426-009af0a1682b/volumes/kubernetes.io~projected/kube-api-access-tskrq DeviceMajor:0 DeviceMinor:212 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f106cd5ffedf78915300e63a93f390a641a0dc289f673bf9730811dd00b89bce/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0b3172c12fe0cb80cb0ba689d2dc46ebb3add53f9f68ecb66db1e0f3c7e8f35f/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cb7dda04a39fa37758507df57f0dc9002834e781ef8e334502efac6fe71b00ad/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/4873d347-3f18-4861-986e-15785bfd25c3/volumes/kubernetes.io~projected/kube-api-access-j794x DeviceMajor:0 DeviceMinor:60 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a/volumes/kubernetes.io~projected/kube-api-access-s8rqr DeviceMajor:0 DeviceMinor:61 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/23ffbb0199c49cd7832a36265d949f8d61fcbdcdc706226d93000220888736a3/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3cfcee7d-4a08-441e-874b-5486b381d0f2/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:208 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/7c068922-cad3-472a-a20a-890955ecb231/volumes/kubernetes.io~projected/kube-api-access-vvj8c DeviceMajor:0 DeviceMinor:220 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4f1962aba89c60bbaaa40d51984227be2d7bcd018f94d2232a5f4dad4ad4aed4/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/937459e4-a573-4d05-980b-b8c42db410f3/volumes/kubernetes.io~projected/kube-api-access-bmdvf DeviceMajor:0 DeviceMinor:59 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8328c2d0-1c49-4619-8ccc-4a238ce29121/volumes/kubernetes.io~projected/kube-api-access-pps4d DeviceMajor:0 DeviceMinor:216 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6fa054a325b204e164a5e95c241ad49d48bad65ad4a437b14a2466a6819a2dff/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dea68d5e3936f78b0a9c72e98e3622718670f36cd81f20f2e6c5b8d393d69303/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b/volumes/kubernetes.io~projected/kube-api-access-zgp75 DeviceMajor:0 DeviceMinor:293 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0533de5ce33c93f1a7d2aa0f2ab6c42fa530f57d6b8738521c09b572d19803bf/userdata/shm DeviceMajor:0 DeviceMinor:340 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0533de5ce33c93f MacAddress:2a:e2:3d:44:5c:39 Speed:10000 Mtu:8901} {Name:0b3172c12fe0cb8 MacAddress:8a:19:84:66:96:1a Speed:10000 Mtu:8901} {Name:31528da19706fb7 MacAddress:0e:d9:18:e6:41:ec Speed:10000 Mtu:8901} {Name:4f1962aba89c60b MacAddress:32:11:79:21:19:bc Speed:10000 Mtu:8901} {Name:641f8c09540ad83 MacAddress:ae:2d:89:4c:5d:b7 Speed:10000 Mtu:8901} {Name:6fa054a325b204e MacAddress:f6:a4:e0:5f:6f:0e Speed:10000 Mtu:8901} {Name:75c168f1e94c8dd MacAddress:26:61:93:a7:e4:4e Speed:10000 Mtu:8901} {Name:91bfb21752db6aa MacAddress:42:44:43:69:c2:3f Speed:10000 Mtu:8901} {Name:99ad65df73e8ab1 MacAddress:52:75:93:82:76:8a Speed:10000 Mtu:8901} {Name:9a39dd8b961fd22 MacAddress:f2:d2:b4:e1:55:7d Speed:10000 Mtu:8901} {Name:9b42edc552da2d5 MacAddress:c2:8c:a0:d4:24:dd Speed:10000 Mtu:8901} {Name:b768c924fe8c63f MacAddress:c2:12:61:22:d4:fb Speed:10000 Mtu:8901} {Name:b89797fb1466c0e MacAddress:8e:89:6f:7a:b7:b7 Speed:10000 Mtu:8901} {Name:bb05a8002385ca2 MacAddress:de:e8:ae:fd:8a:ce Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:d9:77:07:ad Speed:0 Mtu:9001} {Name:br-int MacAddress:e6:5b:46:94:59:7b Speed:0 Mtu:8901} {Name:dea68d5e3936f78 MacAddress:66:5c:7a:e1:81:7c Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:d9:77:07:ad Speed:0 Mtu:9001} {Name:f106cd5ffedf789 MacAddress:e2:44:d6:b6:41:d1 Speed:10000 Mtu:8901} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:0a:5d:5e:ed:61:96 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.548162 5052 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.548207 5052 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.548451 5052 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.548468 5052 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-139.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.548585 5052 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.548593 5052 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.548603 5052 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.548617 5052 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.548697 5052 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.548836 5052 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.548950 5052 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.548983 5052 kubelet.go:493] "Attempting to sync node with API server" Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.548995 5052 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.549004 5052 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.549014 5052 kubelet.go:405] "Adding apiserver pod source" Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.549021 5052 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.549703 5052 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 21:53:10.550158 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.549713 5052 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 21:53:10.550840 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.550219 5052 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 21:53:10.553239 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553225 5052 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 21:53:10.553239 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553239 5052 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 21:53:10.553351 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553340 5052 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 30 21:53:10.553528 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553517 5052 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 21:53:10.553563 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553547 5052 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 21:53:10.553672 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553658 5052 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 21:53:10.553702 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553685 5052 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 21:53:10.553702 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553698 5052 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 21:53:10.553756 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553709 5052 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 21:53:10.553756 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553722 5052 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 21:53:10.553756 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553737 5052 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 21:53:10.553756 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553750 5052 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 21:53:10.553999 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553761 5052 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 21:53:10.553999 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553775 5052 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 21:53:10.553999 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553788 5052 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 21:53:10.553999 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553817 5052 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 21:53:10.553999 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553836 5052 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 21:53:10.553999 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553903 5052 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 21:53:10.553999 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.553917 5052 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 21:53:10.557366 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.557354 5052 server.go:1263] "Started kubelet" Oct 30 21:53:10.557442 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.557408 5052 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 21:53:10.557503 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.557454 5052 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 21:53:10.557553 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.557523 5052 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 21:53:10.558806 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.557783 5052 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 21:53:10.557891 ip-10-0-140-139 systemd[1]: Started Kubernetes Kubelet. Oct 30 21:53:10.562988 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.562965 5052 server.go:317] "Adding debug handlers to kubelet server" Oct 30 21:53:10.565047 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.565024 5052 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 21:53:10.565047 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.565044 5052 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 21:53:10.565199 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.565092 5052 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:47:32 +0000 UTC" deadline="2028-07-21 22:07:05.938841872 +0000 UTC" Oct 30 21:53:10.565199 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.565121 5052 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15120h13m55.373724543s" Oct 30 21:53:10.565199 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.565182 5052 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 21:53:10.565336 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.565212 5052 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 21:53:10.565794 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:10.565188 5052 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-139.us-east-2.compute.internal\" not found" Oct 30 21:53:10.565794 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.565720 5052 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 21:53:10.570655 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.570615 5052 factory.go:153] Registering CRI-O factory Oct 30 21:53:10.570655 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.570638 5052 factory.go:223] Registration of the crio container factory successfully Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.570715 5052 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.570726 5052 factory.go:55] Registering systemd factory Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.570736 5052 factory.go:223] Registration of the systemd container factory successfully Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.570754 5052 factory.go:103] Registering Raw factory Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.570779 5052 manager.go:1199] Started watching for new ooms in manager Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571144 5052 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571184 5052 manager.go:319] Starting recovery of all containers Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571536 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cfcee7d-4a08-441e-874b-5486b381d0f2" volumeName="kubernetes.io/projected/3cfcee7d-4a08-441e-874b-5486b381d0f2-kube-api-access-bb8pz" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571582 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4d4e36e4-7ca2-4e4f-837d-ebdef77734b1" volumeName="kubernetes.io/projected/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-kube-api-access-jl2sc" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571600 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ca45dcf-d2cd-4797-be23-47d5ac33b57b" volumeName="kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-certificates" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571623 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc3ee40a-be4e-476f-91ff-a0cd164812fc" volumeName="kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-default-certificate" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571639 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="012b8527-ec34-4639-b76c-5f941b31d02d" volumeName="kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-image-registry-private-configuration" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571655 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="937459e4-a573-4d05-980b-b8c42db410f3" volumeName="kubernetes.io/projected/937459e4-a573-4d05-980b-b8c42db410f3-kube-api-access-bmdvf" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571676 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ca45dcf-d2cd-4797-be23-47d5ac33b57b" volumeName="kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-trusted-ca" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571691 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4646859-cf39-4d6b-a2e2-f2795635390c" volumeName="kubernetes.io/projected/a4646859-cf39-4d6b-a2e2-f2795635390c-kube-api-access-bd77j" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571720 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4646859-cf39-4d6b-a2e2-f2795635390c" volumeName="kubernetes.io/secret/a4646859-cf39-4d6b-a2e2-f2795635390c-serving-cert" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571734 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d30d11f1-faf2-4cf7-8d92-7bdda003b7c1" volumeName="kubernetes.io/configmap/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-daemon-config" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571755 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40aa6e8d-b731-4ab3-990c-8e9cb8bd582b" volumeName="kubernetes.io/configmap/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-signing-cabundle" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571771 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6f371722-dc8f-48eb-8f8c-28f394ef4360" volumeName="kubernetes.io/projected/6f371722-dc8f-48eb-8f8c-28f394ef4360-kube-api-access-984vh" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571785 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c41902e8-bf12-4ecc-a6e1-b87582b20f86" volumeName="kubernetes.io/projected/c41902e8-bf12-4ecc-a6e1-b87582b20f86-kube-api-access-4gzr6" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571804 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cfb5127e-d35c-4d71-9565-b8044e41f2bc" volumeName="kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cni-binary-copy" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571824 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40aa6e8d-b731-4ab3-990c-8e9cb8bd582b" volumeName="kubernetes.io/secret/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-signing-key" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571843 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4846560b-5370-4fa1-8d36-43dfc4011191" volumeName="kubernetes.io/configmap/4846560b-5370-4fa1-8d36-43dfc4011191-telemetry-config" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571874 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="754f74c1-4a21-4497-bdb6-9b8b1e97842a" volumeName="kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovnkube-script-lib" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571895 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="754f74c1-4a21-4497-bdb6-9b8b1e97842a" volumeName="kubernetes.io/projected/754f74c1-4a21-4497-bdb6-9b8b1e97842a-kube-api-access-2xcw4" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571909 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="754f74c1-4a21-4497-bdb6-9b8b1e97842a" volumeName="kubernetes.io/secret/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovn-node-metrics-cert" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571923 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b6b30cd9-d376-4e9e-8f95-d4d2c504cd93" volumeName="kubernetes.io/projected/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-kube-api-access-9mv6g" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571943 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b" volumeName="kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571957 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="57645c9d-50be-44cf-8ae7-c0c3103b2a78" volumeName="kubernetes.io/secret/57645c9d-50be-44cf-8ae7-c0c3103b2a78-agent-certs" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571976 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="754f74c1-4a21-4497-bdb6-9b8b1e97842a" volumeName="kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovnkube-config" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.571991 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88107d0e-6b47-4320-8647-2a597f418bf4" volumeName="kubernetes.io/secret/88107d0e-6b47-4320-8647-2a597f418bf4-serving-cert" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572005 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="937459e4-a573-4d05-980b-b8c42db410f3" volumeName="kubernetes.io/empty-dir/937459e4-a573-4d05-980b-b8c42db410f3-etc-tuned" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572025 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ca45dcf-d2cd-4797-be23-47d5ac33b57b" volumeName="kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-bound-sa-token" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572041 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="012b8527-ec34-4639-b76c-5f941b31d02d" volumeName="kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-registry-certificates" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572061 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="012b8527-ec34-4639-b76c-5f941b31d02d" volumeName="kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-trusted-ca" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572088 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cfcee7d-4a08-441e-874b-5486b381d0f2" volumeName="kubernetes.io/empty-dir/3cfcee7d-4a08-441e-874b-5486b381d0f2-tmp" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572104 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4873d347-3f18-4861-986e-15785bfd25c3" volumeName="kubernetes.io/projected/4873d347-3f18-4861-986e-15785bfd25c3-kube-api-access-j794x" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572137 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f473fc1-7e45-4581-9426-009af0a1682b" volumeName="kubernetes.io/projected/7f473fc1-7e45-4581-9426-009af0a1682b-kube-api-access-tskrq" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572156 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4646859-cf39-4d6b-a2e2-f2795635390c" volumeName="kubernetes.io/configmap/a4646859-cf39-4d6b-a2e2-f2795635390c-config" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572172 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c41902e8-bf12-4ecc-a6e1-b87582b20f86" volumeName="kubernetes.io/configmap/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-config" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572191 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="012b8527-ec34-4639-b76c-5f941b31d02d" volumeName="kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-installation-pull-secrets" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572220 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="181f4022-4f53-4e23-8424-01f6b5e06ec6" volumeName="kubernetes.io/secret/181f4022-4f53-4e23-8424-01f6b5e06ec6-cert" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572235 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="57645c9d-50be-44cf-8ae7-c0c3103b2a78" volumeName="kubernetes.io/configmap/57645c9d-50be-44cf-8ae7-c0c3103b2a78-konnectivity-ca" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572254 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88107d0e-6b47-4320-8647-2a597f418bf4" volumeName="kubernetes.io/projected/88107d0e-6b47-4320-8647-2a597f418bf4-kube-api-access-gr8d5" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572266 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc3ee40a-be4e-476f-91ff-a0cd164812fc" volumeName="kubernetes.io/projected/cc3ee40a-be4e-476f-91ff-a0cd164812fc-kube-api-access-2lx28" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572284 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cfb5127e-d35c-4d71-9565-b8044e41f2bc" volumeName="kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cni-sysctl-allowlist" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572297 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cfcee7d-4a08-441e-874b-5486b381d0f2" volumeName="kubernetes.io/empty-dir/3cfcee7d-4a08-441e-874b-5486b381d0f2-snapshots" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572310 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4d4e36e4-7ca2-4e4f-837d-ebdef77734b1" volumeName="kubernetes.io/empty-dir/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-tmp-dir" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572327 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c068922-cad3-472a-a20a-890955ecb231" volumeName="kubernetes.io/configmap/7c068922-cad3-472a-a20a-890955ecb231-trusted-ca" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572340 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c068922-cad3-472a-a20a-890955ecb231" volumeName="kubernetes.io/projected/7c068922-cad3-472a-a20a-890955ecb231-kube-api-access-vvj8c" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572357 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2746830-9846-4bb6-afc2-713e6a5cd2e8" volumeName="kubernetes.io/projected/f2746830-9846-4bb6-afc2-713e6a5cd2e8-kube-api-access-8c7wj" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572371 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88107d0e-6b47-4320-8647-2a597f418bf4" volumeName="kubernetes.io/configmap/88107d0e-6b47-4320-8647-2a597f418bf4-config" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572384 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ca45dcf-d2cd-4797-be23-47d5ac33b57b" volumeName="kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-installation-pull-secrets" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572400 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cfb5127e-d35c-4d71-9565-b8044e41f2bc" volumeName="kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572413 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a" volumeName="kubernetes.io/configmap/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-serviceca" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572429 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a" volumeName="kubernetes.io/projected/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-kube-api-access-s8rqr" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572442 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e23d7533-e36d-460f-b8f4-18d4f38dd0e7" volumeName="kubernetes.io/projected/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-kube-api-access-vt255" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572456 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2746830-9846-4bb6-afc2-713e6a5cd2e8" volumeName="kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-service-ca-bundle" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572474 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2746830-9846-4bb6-afc2-713e6a5cd2e8" volumeName="kubernetes.io/empty-dir/f2746830-9846-4bb6-afc2-713e6a5cd2e8-archives-path" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572486 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d901cac-9d8d-48f8-b1a6-61ae43d46721" volumeName="kubernetes.io/configmap/3d901cac-9d8d-48f8-b1a6-61ae43d46721-config-volume" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572504 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d901cac-9d8d-48f8-b1a6-61ae43d46721" volumeName="kubernetes.io/empty-dir/3d901cac-9d8d-48f8-b1a6-61ae43d46721-tmp-dir" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572517 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4846560b-5370-4fa1-8d36-43dfc4011191" volumeName="kubernetes.io/projected/4846560b-5370-4fa1-8d36-43dfc4011191-kube-api-access-w5g2m" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572530 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c068922-cad3-472a-a20a-890955ecb231" volumeName="kubernetes.io/secret/7c068922-cad3-472a-a20a-890955ecb231-serving-cert" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572567 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc3ee40a-be4e-476f-91ff-a0cd164812fc" volumeName="kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-stats-auth" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572580 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cfb5127e-d35c-4d71-9565-b8044e41f2bc" volumeName="kubernetes.io/projected/cfb5127e-d35c-4d71-9565-b8044e41f2bc-kube-api-access-sx6dh" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572601 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="012b8527-ec34-4639-b76c-5f941b31d02d" volumeName="kubernetes.io/empty-dir/012b8527-ec34-4639-b76c-5f941b31d02d-ca-trust-extracted" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572615 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="012b8527-ec34-4639-b76c-5f941b31d02d" volumeName="kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-kube-api-access-k6pqj" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572629 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3444842c-2f38-409f-ba87-e21af956df52" volumeName="kubernetes.io/projected/3444842c-2f38-409f-ba87-e21af956df52-kube-api-access-z22xr" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572647 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cfcee7d-4a08-441e-874b-5486b381d0f2" volumeName="kubernetes.io/configmap/3cfcee7d-4a08-441e-874b-5486b381d0f2-trusted-ca-bundle" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572662 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cfcee7d-4a08-441e-874b-5486b381d0f2" volumeName="kubernetes.io/configmap/3cfcee7d-4a08-441e-874b-5486b381d0f2-service-ca-bundle" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572679 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d901cac-9d8d-48f8-b1a6-61ae43d46721" volumeName="kubernetes.io/projected/3d901cac-9d8d-48f8-b1a6-61ae43d46721-kube-api-access-q9ln7" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572692 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40aa6e8d-b731-4ab3-990c-8e9cb8bd582b" volumeName="kubernetes.io/projected/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-kube-api-access-vf456" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572705 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ca45dcf-d2cd-4797-be23-47d5ac33b57b" volumeName="kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-image-registry-private-configuration" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572722 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="181f4022-4f53-4e23-8424-01f6b5e06ec6" volumeName="kubernetes.io/projected/181f4022-4f53-4e23-8424-01f6b5e06ec6-kube-api-access-x9cqn" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572735 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ca45dcf-d2cd-4797-be23-47d5ac33b57b" volumeName="kubernetes.io/empty-dir/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-ca-trust-extracted" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572764 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ca45dcf-d2cd-4797-be23-47d5ac33b57b" volumeName="kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-kube-api-access-vcwnh" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572778 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d30d11f1-faf2-4cf7-8d92-7bdda003b7c1" volumeName="kubernetes.io/configmap/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-cni-binary-copy" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572791 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d30d11f1-faf2-4cf7-8d92-7bdda003b7c1" volumeName="kubernetes.io/projected/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-kube-api-access-62fhs" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572810 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2746830-9846-4bb6-afc2-713e6a5cd2e8" volumeName="kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-trusted-ca-bundle" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572823 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="012b8527-ec34-4639-b76c-5f941b31d02d" volumeName="kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-bound-sa-token" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572842 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="187603a7-5181-4c01-b7d2-3d7a56796255" volumeName="kubernetes.io/projected/187603a7-5181-4c01-b7d2-3d7a56796255-kube-api-access-m25k7" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572874 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cfcee7d-4a08-441e-874b-5486b381d0f2" volumeName="kubernetes.io/secret/3cfcee7d-4a08-441e-874b-5486b381d0f2-serving-cert" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572889 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9101efec-ec15-4f30-929d-a3bcfd851caa" volumeName="kubernetes.io/empty-dir/9101efec-ec15-4f30-929d-a3bcfd851caa-data-volume" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572909 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9101efec-ec15-4f30-929d-a3bcfd851caa" volumeName="kubernetes.io/projected/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-api-access-9dqrt" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572925 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c7c738de-1f94-4fb0-a389-84512dcb22b9" volumeName="kubernetes.io/projected/c7c738de-1f94-4fb0-a389-84512dcb22b9-kube-api-access-wcnlq" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572944 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e23d7533-e36d-460f-b8f4-18d4f38dd0e7" volumeName="kubernetes.io/configmap/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-iptables-alerter-script" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572958 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="38da3026-ac7f-44af-aa6c-f16cf3082c9e" volumeName="kubernetes.io/configmap/38da3026-ac7f-44af-aa6c-f16cf3082c9e-nginx-conf" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572974 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c068922-cad3-472a-a20a-890955ecb231" volumeName="kubernetes.io/configmap/7c068922-cad3-472a-a20a-890955ecb231-config" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.572994 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8328c2d0-1c49-4619-8ccc-4a238ce29121" volumeName="kubernetes.io/projected/8328c2d0-1c49-4619-8ccc-4a238ce29121-kube-api-access-pps4d" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.573009 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="937459e4-a573-4d05-980b-b8c42db410f3" volumeName="kubernetes.io/empty-dir/937459e4-a573-4d05-980b-b8c42db410f3-tmp" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.573027 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="daafa095-7904-4d87-ad51-83577c6d1452" volumeName="kubernetes.io/projected/daafa095-7904-4d87-ad51-83577c6d1452-kube-api-access-87f7c" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.573057 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="754f74c1-4a21-4497-bdb6-9b8b1e97842a" volumeName="kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-env-overrides" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.573071 5052 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="967b7974-ef9d-4eff-8265-879c05e6fc96" volumeName="kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret" seLinuxMountContext="" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.573084 5052 reconstruct.go:97] "Volume reconstruction finished" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.573098 5052 reconciler.go:29] "Reconciler: start to sync state" Oct 30 21:53:10.576959 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.574127 5052 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:53:10.580495 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.580478 5052 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:53:10.581467 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.581448 5052 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 30 21:53:10.588210 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.588187 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/1.log" Oct 30 21:53:10.589262 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.589238 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/1.log" Oct 30 21:53:10.600360 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.600327 5052 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 21:53:10.601868 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.601829 5052 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 21:53:10.601957 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.601853 5052 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 21:53:10.601957 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.601911 5052 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 21:53:10.602067 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:10.601952 5052 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 30 21:53:10.606007 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.605980 5052 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:53:10.615505 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.615480 5052 generic.go:356] "Generic (PLEG): container finished" podID="4c692c4e8d6c927c981b5bf36ba589e2" containerID="f4b93e70b6487b6df07b8f2931a5271d866f26f4198dc92ca48e74890ab8e7a8" exitCode=0 Oct 30 21:53:10.620729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.620705 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/1.log" Oct 30 21:53:10.620825 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.620745 5052 generic.go:356] "Generic (PLEG): container finished" podID="7c068922-cad3-472a-a20a-890955ecb231" containerID="0460225e186b8a286a1732a9d921f46e9978325a451def36afdb4689d7eb8151" exitCode=255 Oct 30 21:53:10.632237 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.632213 5052 generic.go:356] "Generic (PLEG): container finished" podID="cfb5127e-d35c-4d71-9565-b8044e41f2bc" containerID="71f918d5f6a42b5cfacf79802c2df2816bf23a433ebcf3b260d39012d80dc0e3" exitCode=0 Oct 30 21:53:10.632237 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.632235 5052 generic.go:356] "Generic (PLEG): container finished" podID="cfb5127e-d35c-4d71-9565-b8044e41f2bc" containerID="bf36c2895f43b0d56bd60d6bec76a52225da7fa6ef8af1198704685c690ce5ca" exitCode=0 Oct 30 21:53:10.632375 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.632241 5052 generic.go:356] "Generic (PLEG): container finished" podID="cfb5127e-d35c-4d71-9565-b8044e41f2bc" containerID="79ea3a7bc30a6b393cb3369eaa3c3ec9857288bd5a900a7cd1fd88a600d0750f" exitCode=0 Oct 30 21:53:10.632375 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.632247 5052 generic.go:356] "Generic (PLEG): container finished" podID="cfb5127e-d35c-4d71-9565-b8044e41f2bc" containerID="851cd0569415566420a95756da3d38a9de55543d0a05ca13a3d51274535d3301" exitCode=0 Oct 30 21:53:10.632375 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.632253 5052 generic.go:356] "Generic (PLEG): container finished" podID="cfb5127e-d35c-4d71-9565-b8044e41f2bc" containerID="dd62555289368901e74b2210e0e3001e5e507bfb4cea4f98eba3c2f4cc675ed6" exitCode=0 Oct 30 21:53:10.632375 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.632258 5052 generic.go:356] "Generic (PLEG): container finished" podID="cfb5127e-d35c-4d71-9565-b8044e41f2bc" containerID="ba66e007417e9f11ca9aeb675f187517f725e51988b96a8eb6ff7d439b698afe" exitCode=0 Oct 30 21:53:10.673268 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.673219 5052 manager.go:324] Recovery completed Oct 30 21:53:10.692503 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.692482 5052 cpu_manager.go:226] "Starting" policy="none" Oct 30 21:53:10.692503 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.692497 5052 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 21:53:10.692611 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.692520 5052 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 21:53:10.692674 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.692661 5052 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 30 21:53:10.692705 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.692675 5052 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 30 21:53:10.692705 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.692690 5052 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 30 21:53:10.692705 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.692696 5052 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 30 21:53:10.692705 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.692702 5052 policy_none.go:50] "Start" Oct 30 21:53:10.692822 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.692710 5052 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 21:53:10.692822 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.692718 5052 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 21:53:10.699127 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.699109 5052 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 30 21:53:10.699127 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.699129 5052 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 30 21:53:10.699216 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.699136 5052 policy_none.go:44] "Start" Oct 30 21:53:10.702133 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:10.702108 5052 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Oct 30 21:53:10.704837 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.704811 5052 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 21:53:10.709202 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.709187 5052 manager.go:341] "Starting Device Plugin manager" Oct 30 21:53:10.709626 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:10.709214 5052 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 21:53:10.709696 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.709629 5052 server.go:87] "Starting device plugin registration server" Oct 30 21:53:10.709944 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.709930 5052 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 21:53:10.710020 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.709943 5052 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 21:53:10.710082 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.710038 5052 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 21:53:10.710234 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.710180 5052 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 21:53:10.710234 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.710231 5052 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 21:53:10.710342 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.710238 5052 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 21:53:10.710391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.710294 5052 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:53:10.710220363Z","UUID":"c016c95d-a840-4b88-94cd-2029a3622708","Handler":null,"Name":"","Endpoint":""} Oct 30 21:53:10.711645 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:10.711603 5052 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 21:53:10.711741 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.711657 5052 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 21:53:10.711741 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.711681 5052 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 21:53:10.811062 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.811038 5052 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:53:10.812085 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.812061 5052 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:53:10.812169 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.812103 5052 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:53:10.812169 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.812115 5052 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-139.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:53:10.812169 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.812153 5052 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:10.826163 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.826142 5052 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:10.826241 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.826192 5052 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:10.902593 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.902543 5052 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal"] Oct 30 21:53:10.903156 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.903112 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" event={"ID":"4c692c4e8d6c927c981b5bf36ba589e2","Type":"ContainerStarted","Data":"9bc313b97460ec163a7489726d1224d1367d9adeabae7ce36d85f93cff00434e"} Oct 30 21:53:10.903223 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.903168 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" event={"ID":"4c692c4e8d6c927c981b5bf36ba589e2","Type":"ContainerDied","Data":"f4b93e70b6487b6df07b8f2931a5271d866f26f4198dc92ca48e74890ab8e7a8"} Oct 30 21:53:10.903223 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.903192 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" event={"ID":"4c692c4e8d6c927c981b5bf36ba589e2","Type":"ContainerStarted","Data":"cb7dda04a39fa37758507df57f0dc9002834e781ef8e334502efac6fe71b00ad"} Oct 30 21:53:10.903285 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.903235 5052 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:10.903317 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.903290 5052 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:10.903383 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.903293 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" event={"ID":"b10322e84c5fc9db7c569a5553b27b9d","Type":"ContainerStarted","Data":"6c140bb6b1e3892c0ee16ee6e41084b1214a99f0561da62cbfe5bc00517bdb13"} Oct 30 21:53:10.903415 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.903393 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" event={"ID":"b10322e84c5fc9db7c569a5553b27b9d","Type":"ContainerStarted","Data":"b61a0e2e382177458b759f1f9b6113c77e16287ead5e9551e7e52381aa5f9096"} Oct 30 21:53:10.917765 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.917742 5052 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:53:10.917842 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:10.917783 5052 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:10.918500 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.918485 5052 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:53:10.918548 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:10.918521 5052 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:10.984162 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.984140 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c692c4e8d6c927c981b5bf36ba589e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"4c692c4e8d6c927c981b5bf36ba589e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:10.984250 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.984168 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c692c4e8d6c927c981b5bf36ba589e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"4c692c4e8d6c927c981b5bf36ba589e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:10.984250 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:10.984186 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b10322e84c5fc9db7c569a5553b27b9d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"b10322e84c5fc9db7c569a5553b27b9d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:11.084457 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.084432 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c692c4e8d6c927c981b5bf36ba589e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"4c692c4e8d6c927c981b5bf36ba589e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:11.084457 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.084446 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c692c4e8d6c927c981b5bf36ba589e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"4c692c4e8d6c927c981b5bf36ba589e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:11.084594 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.084476 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c692c4e8d6c927c981b5bf36ba589e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"4c692c4e8d6c927c981b5bf36ba589e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:11.084594 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.084502 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b10322e84c5fc9db7c569a5553b27b9d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"b10322e84c5fc9db7c569a5553b27b9d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:11.084594 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.084548 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b10322e84c5fc9db7c569a5553b27b9d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"b10322e84c5fc9db7c569a5553b27b9d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:11.084594 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.084578 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c692c4e8d6c927c981b5bf36ba589e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal\" (UID: \"4c692c4e8d6c927c981b5bf36ba589e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:11.549762 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.549735 5052 apiserver.go:52] "Watching apiserver" Oct 30 21:53:11.559518 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.559492 5052 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 21:53:11.560165 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.560142 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6585488f54-nw2ht","openshift-image-registry/image-registry-7b99f4cc75-7drms","openshift-service-ca/service-ca-5fffc97bdf-d9ljx","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh","openshift-dns/node-resolver-4d225","openshift-cluster-node-tuning-operator/tuned-hchhj","openshift-insights/periodic-gathering-lzjkn-79bnz","openshift-dns/dns-default-sq7zn","openshift-multus/multus-7s4gp","openshift-ingress-canary/ingress-canary-sgzrz","openshift-network-operator/iptables-alerter-npvbd","openshift-insights/insights-runtime-extractor-rgkfs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal","openshift-insights/insights-operator-7c4986d449-frqg6","openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr","kube-system/kas-connection-checker-685895c7c9-zswrm","openshift-network-diagnostics/network-check-source-6f78d59f99-rsx79","openshift-kube-storage-version-migrator/migrator-66df5d496b-lhvx9","openshift-ingress/router-default-6c8767fbdc-sxmpb","kube-system/kas-connection-checker-685895c7c9-bqtvv","kube-system/kas-connection-checker-685895c7c9-n2r6j","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl","kube-system/global-pull-secret-syncer-s5jhm","openshift-console-operator/console-operator-7cd56b8dbc-hn7m5","openshift-network-console/networking-console-plugin-86c478bb88-4fs6t","openshift-image-registry/node-ca-dgfl4","openshift-ovn-kubernetes/ovnkube-node-d75zh","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-l9ktm","openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp","openshift-multus/multus-additional-cni-plugins-vpw8h","openshift-multus/network-metrics-daemon-ztlk7","kube-system/konnectivity-agent-25wb5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww","openshift-kube-storage-version-migrator/migrator-66df5d496b-bl46l","openshift-network-diagnostics/network-check-target-dxkrb","kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal"] Oct 30 21:53:11.562362 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.562342 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:53:11.562672 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.562649 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:11.563390 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.563375 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:53:11.564551 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.564534 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.565024 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.565008 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:53:11.565206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.565187 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.565272 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.565195 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.565668 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.565649 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Oct 30 21:53:11.565838 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.565821 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.565977 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.565838 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.566079 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.566061 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:53:11.567092 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.567068 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.567358 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.567334 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Oct 30 21:53:11.567516 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.567361 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.567516 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.567370 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.567516 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.567392 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.567516 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.567406 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Oct 30 21:53:11.568403 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.567569 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.568543 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.568522 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Oct 30 21:53:11.568713 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.568691 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.569391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.569373 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.569691 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.569669 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Oct 30 21:53:11.569873 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.569835 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dtfm6\"" Oct 30 21:53:11.570106 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.570087 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Oct 30 21:53:11.570674 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.570652 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-chfpx\"" Oct 30 21:53:11.570938 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.570920 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rccpg\"" Oct 30 21:53:11.572843 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.572817 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.572843 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.572836 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.573106 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.572845 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.573106 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.572848 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.573106 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.572877 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Oct 30 21:53:11.573106 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.572910 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Oct 30 21:53:11.573106 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.572917 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Oct 30 21:53:11.573106 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.572950 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.573106 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.572970 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.573106 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.572986 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.573106 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573016 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zxtr5\"" Oct 30 21:53:11.573106 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573067 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573125 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573138 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573144 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573149 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573165 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573177 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573184 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573192 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573197 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573543 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573548 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573561 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573568 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573597 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573606 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 21:53:11.573667 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.573617 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.574870 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.574838 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 21:53:11.574870 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.574839 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8689j\"" Oct 30 21:53:11.575008 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.574891 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8glf6\"" Oct 30 21:53:11.575008 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.574910 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 21:53:11.575008 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.574922 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 21:53:11.575008 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.574946 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 30 21:53:11.575008 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.574962 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hhtlp\"" Oct 30 21:53:11.575008 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.574977 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Oct 30 21:53:11.575436 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.575046 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 21:53:11.575436 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.575052 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-7pfmv\"" Oct 30 21:53:11.575436 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.575053 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Oct 30 21:53:11.575436 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.575106 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mqkw9\"" Oct 30 21:53:11.575436 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.575119 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kxljf\"" Oct 30 21:53:11.575436 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.575137 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4qnnv\"" Oct 30 21:53:11.575436 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.575166 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 21:53:11.575436 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.575199 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lpdnh\"" Oct 30 21:53:11.575436 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.575207 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-qzflj\"" Oct 30 21:53:11.575436 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.575210 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bcrlz\"" Oct 30 21:53:11.575436 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.575238 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-scccg\"" Oct 30 21:53:11.576979 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.576961 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Oct 30 21:53:11.577052 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.576988 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 30 21:53:11.577385 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.577375 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.578399 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.578384 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:11.580378 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.580363 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:11.580520 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.580499 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Oct 30 21:53:11.581773 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.581752 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 21:53:11.581773 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.581763 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 21:53:11.582709 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.582687 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 21:53:11.583015 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.582998 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.583258 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.583241 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 21:53:11.583335 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.583279 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 21:53:11.583576 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.583556 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.583576 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.583572 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-hgb4n\"" Oct 30 21:53:11.583888 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.583841 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 21:53:11.583977 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.583888 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 30 21:53:11.583977 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.583917 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 21:53:11.584243 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.584227 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.584484 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.584465 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.584580 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.584563 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q26ql\"" Oct 30 21:53:11.584690 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.584674 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-bwmbw\"" Oct 30 21:53:11.584746 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.584727 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-sr8tx\"" Oct 30 21:53:11.584818 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.584802 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-42md8\"" Oct 30 21:53:11.584976 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.584958 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 30 21:53:11.585048 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.584987 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.585111 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585094 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 30 21:53:11.585165 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585157 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 21:53:11.585233 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585216 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.585289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585230 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 21:53:11.585381 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585364 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 21:53:11.585439 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585427 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gpwbs\"" Oct 30 21:53:11.585488 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585444 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.585539 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585522 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.585583 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.584894 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.585629 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585610 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.585674 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585631 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pzcl5\"" Oct 30 21:53:11.585674 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585645 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 21:53:11.585674 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585656 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 21:53:11.585804 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585702 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9kpks\"" Oct 30 21:53:11.585804 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585750 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.585804 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585798 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 21:53:11.585951 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585839 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4xh5g\"" Oct 30 21:53:11.585951 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585850 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.585951 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.584815 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l9jfx\"" Oct 30 21:53:11.586093 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.585988 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 21:53:11.586093 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.586007 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 21:53:11.586093 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.584477 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-lttxg\"" Oct 30 21:53:11.586093 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.586036 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ddnf5\"" Oct 30 21:53:11.586093 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.586081 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 21:53:11.586340 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.584970 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-whw8p\"" Oct 30 21:53:11.586912 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.586886 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4646859-cf39-4d6b-a2e2-f2795635390c-serving-cert\") pod \"service-ca-operator-544d749c8c-8xqzr\" (UID: \"a4646859-cf39-4d6b-a2e2-f2795635390c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:53:11.586987 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.586918 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-default-certificate\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:11.586987 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.586934 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cfcee7d-4a08-441e-874b-5486b381d0f2-tmp\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:53:11.586987 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.586953 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-trusted-ca\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.586987 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.586981 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6pqj\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-kube-api-access-k6pqj\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.587144 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587007 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:53:11.587144 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587033 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c068922-cad3-472a-a20a-890955ecb231-config\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:53:11.587144 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587055 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4646859-cf39-4d6b-a2e2-f2795635390c-config\") pod \"service-ca-operator-544d749c8c-8xqzr\" (UID: \"a4646859-cf39-4d6b-a2e2-f2795635390c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:53:11.587144 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587060 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cfcee7d-4a08-441e-874b-5486b381d0f2-tmp\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:53:11.587144 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587116 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:11.587381 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587191 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cfcee7d-4a08-441e-874b-5486b381d0f2-service-ca-bundle\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:53:11.587381 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587203 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-default-certificate\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:11.587381 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587230 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-registry-certificates\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.587381 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587285 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvj8c\" (UniqueName: \"kubernetes.io/projected/7c068922-cad3-472a-a20a-890955ecb231-kube-api-access-vvj8c\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:53:11.587381 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587305 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4646859-cf39-4d6b-a2e2-f2795635390c-serving-cert\") pod \"service-ca-operator-544d749c8c-8xqzr\" (UID: \"a4646859-cf39-4d6b-a2e2-f2795635390c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:53:11.587381 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587339 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c068922-cad3-472a-a20a-890955ecb231-config\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:53:11.587381 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587381 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cfcee7d-4a08-441e-874b-5486b381d0f2-service-ca-bundle\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:53:11.587700 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587407 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-registry-certificates\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.587700 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587441 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd77j\" (UniqueName: \"kubernetes.io/projected/a4646859-cf39-4d6b-a2e2-f2795635390c-kube-api-access-bd77j\") pod \"service-ca-operator-544d749c8c-8xqzr\" (UID: \"a4646859-cf39-4d6b-a2e2-f2795635390c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:53:11.587700 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587471 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-trusted-ca\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.587700 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587471 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3cfcee7d-4a08-441e-874b-5486b381d0f2-snapshots\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:53:11.587700 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587517 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-installation-pull-secrets\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.587700 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587543 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mv6g\" (UniqueName: \"kubernetes.io/projected/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-kube-api-access-9mv6g\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:53:11.587700 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587569 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tskrq\" (UniqueName: \"kubernetes.io/projected/7f473fc1-7e45-4581-9426-009af0a1682b-kube-api-access-tskrq\") pod \"kas-connection-checker-685895c7c9-zswrm\" (UID: \"7f473fc1-7e45-4581-9426-009af0a1682b\") " pod="kube-system/kas-connection-checker-685895c7c9-zswrm" Oct 30 21:53:11.587700 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587591 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pps4d\" (UniqueName: \"kubernetes.io/projected/8328c2d0-1c49-4619-8ccc-4a238ce29121-kube-api-access-pps4d\") pod \"kas-connection-checker-685895c7c9-bqtvv\" (UID: \"8328c2d0-1c49-4619-8ccc-4a238ce29121\") " pod="kube-system/kas-connection-checker-685895c7c9-bqtvv" Oct 30 21:53:11.587700 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587616 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr8d5\" (UniqueName: \"kubernetes.io/projected/88107d0e-6b47-4320-8647-2a597f418bf4-kube-api-access-gr8d5\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl\" (UID: \"88107d0e-6b47-4320-8647-2a597f418bf4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:53:11.587700 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587635 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4646859-cf39-4d6b-a2e2-f2795635390c-config\") pod \"service-ca-operator-544d749c8c-8xqzr\" (UID: \"a4646859-cf39-4d6b-a2e2-f2795635390c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:53:11.587700 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587642 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-image-registry-private-configuration\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.587700 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587665 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:53:11.587700 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587679 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-installation-pull-secrets\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.587700 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587686 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57645c9d-50be-44cf-8ae7-c0c3103b2a78-agent-certs\") pod \"konnectivity-agent-25wb5\" (UID: \"57645c9d-50be-44cf-8ae7-c0c3103b2a78\") " pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587710 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57645c9d-50be-44cf-8ae7-c0c3103b2a78-konnectivity-ca\") pod \"konnectivity-agent-25wb5\" (UID: \"57645c9d-50be-44cf-8ae7-c0c3103b2a78\") " pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587733 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-stats-auth\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587760 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-4fs6t\" (UID: \"38da3026-ac7f-44af-aa6c-f16cf3082c9e\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587812 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4846560b-5370-4fa1-8d36-43dfc4011191-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587835 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cfcee7d-4a08-441e-874b-5486b381d0f2-serving-cert\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587875 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb8pz\" (UniqueName: \"kubernetes.io/projected/3cfcee7d-4a08-441e-874b-5486b381d0f2-kube-api-access-bb8pz\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587879 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-image-registry-private-configuration\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587903 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c068922-cad3-472a-a20a-890955ecb231-serving-cert\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587904 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3cfcee7d-4a08-441e-874b-5486b381d0f2-snapshots\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587928 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/38da3026-ac7f-44af-aa6c-f16cf3082c9e-nginx-conf\") pod \"networking-console-plugin-86c478bb88-4fs6t\" (UID: \"38da3026-ac7f-44af-aa6c-f16cf3082c9e\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587932 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.587953 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588004 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z22xr\" (UniqueName: \"kubernetes.io/projected/3444842c-2f38-409f-ba87-e21af956df52-kube-api-access-z22xr\") pod \"network-check-source-6f78d59f99-rsx79\" (UID: \"3444842c-2f38-409f-ba87-e21af956df52\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rsx79" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588036 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588038 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57645c9d-50be-44cf-8ae7-c0c3103b2a78-konnectivity-ca\") pod \"konnectivity-agent-25wb5\" (UID: \"57645c9d-50be-44cf-8ae7-c0c3103b2a78\") " pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588098 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c068922-cad3-472a-a20a-890955ecb231-serving-cert\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588112 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57645c9d-50be-44cf-8ae7-c0c3103b2a78-agent-certs\") pod \"konnectivity-agent-25wb5\" (UID: \"57645c9d-50be-44cf-8ae7-c0c3103b2a78\") " pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588120 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4846560b-5370-4fa1-8d36-43dfc4011191-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588164 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-stats-auth\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588192 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/012b8527-ec34-4639-b76c-5f941b31d02d-ca-trust-extracted\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588236 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/38da3026-ac7f-44af-aa6c-f16cf3082c9e-nginx-conf\") pod \"networking-console-plugin-86c478bb88-4fs6t\" (UID: \"38da3026-ac7f-44af-aa6c-f16cf3082c9e\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:53:11.588289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588303 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-bound-sa-token\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588328 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/012b8527-ec34-4639-b76c-5f941b31d02d-ca-trust-extracted\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588331 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c068922-cad3-472a-a20a-890955ecb231-trusted-ca\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588401 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cfcee7d-4a08-441e-874b-5486b381d0f2-serving-cert\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588433 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588468 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnlq\" (UniqueName: \"kubernetes.io/projected/c7c738de-1f94-4fb0-a389-84512dcb22b9-kube-api-access-wcnlq\") pod \"kas-connection-checker-685895c7c9-n2r6j\" (UID: \"c7c738de-1f94-4fb0-a389-84512dcb22b9\") " pod="kube-system/kas-connection-checker-685895c7c9-n2r6j" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588495 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5g2m\" (UniqueName: \"kubernetes.io/projected/4846560b-5370-4fa1-8d36-43dfc4011191-kube-api-access-w5g2m\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588533 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88107d0e-6b47-4320-8647-2a597f418bf4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl\" (UID: \"88107d0e-6b47-4320-8647-2a597f418bf4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588562 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cfcee7d-4a08-441e-874b-5486b381d0f2-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588588 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588615 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzr6\" (UniqueName: \"kubernetes.io/projected/c41902e8-bf12-4ecc-a6e1-b87582b20f86-kube-api-access-4gzr6\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588639 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c068922-cad3-472a-a20a-890955ecb231-trusted-ca\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588657 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-984vh\" (UniqueName: \"kubernetes.io/projected/6f371722-dc8f-48eb-8f8c-28f394ef4360-kube-api-access-984vh\") pod \"volume-data-source-validator-58c9f5f46d-l9ktm\" (UID: \"6f371722-dc8f-48eb-8f8c-28f394ef4360\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-l9ktm" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588700 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lx28\" (UniqueName: \"kubernetes.io/projected/cc3ee40a-be4e-476f-91ff-a0cd164812fc-kube-api-access-2lx28\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588718 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88107d0e-6b47-4320-8647-2a597f418bf4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl\" (UID: \"88107d0e-6b47-4320-8647-2a597f418bf4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588729 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88107d0e-6b47-4320-8647-2a597f418bf4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl\" (UID: \"88107d0e-6b47-4320-8647-2a597f418bf4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588873 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cfcee7d-4a08-441e-874b-5486b381d0f2-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:53:11.589206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.588915 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88107d0e-6b47-4320-8647-2a597f418bf4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl\" (UID: \"88107d0e-6b47-4320-8647-2a597f418bf4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:53:11.599027 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.599003 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mv6g\" (UniqueName: \"kubernetes.io/projected/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-kube-api-access-9mv6g\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:53:11.599333 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.599319 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6pqj\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-kube-api-access-k6pqj\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.602622 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.602594 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tskrq\" (UniqueName: \"kubernetes.io/projected/7f473fc1-7e45-4581-9426-009af0a1682b-kube-api-access-tskrq\") pod \"kas-connection-checker-685895c7c9-zswrm\" (UID: \"7f473fc1-7e45-4581-9426-009af0a1682b\") " pod="kube-system/kas-connection-checker-685895c7c9-zswrm" Oct 30 21:53:11.602888 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.602829 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvj8c\" (UniqueName: \"kubernetes.io/projected/7c068922-cad3-472a-a20a-890955ecb231-kube-api-access-vvj8c\") pod \"console-operator-7cd56b8dbc-hn7m5\" (UID: \"7c068922-cad3-472a-a20a-890955ecb231\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:53:11.602997 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.602947 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-bound-sa-token\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.603289 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.603268 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcnlq\" (UniqueName: \"kubernetes.io/projected/c7c738de-1f94-4fb0-a389-84512dcb22b9-kube-api-access-wcnlq\") pod \"kas-connection-checker-685895c7c9-n2r6j\" (UID: \"c7c738de-1f94-4fb0-a389-84512dcb22b9\") " pod="kube-system/kas-connection-checker-685895c7c9-n2r6j" Oct 30 21:53:11.603450 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.603425 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr8d5\" (UniqueName: \"kubernetes.io/projected/88107d0e-6b47-4320-8647-2a597f418bf4-kube-api-access-gr8d5\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl\" (UID: \"88107d0e-6b47-4320-8647-2a597f418bf4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" Oct 30 21:53:11.603515 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.603454 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd77j\" (UniqueName: \"kubernetes.io/projected/a4646859-cf39-4d6b-a2e2-f2795635390c-kube-api-access-bd77j\") pod \"service-ca-operator-544d749c8c-8xqzr\" (UID: \"a4646859-cf39-4d6b-a2e2-f2795635390c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" Oct 30 21:53:11.603603 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.603582 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5g2m\" (UniqueName: \"kubernetes.io/projected/4846560b-5370-4fa1-8d36-43dfc4011191-kube-api-access-w5g2m\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:53:11.603672 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.603652 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gzr6\" (UniqueName: \"kubernetes.io/projected/c41902e8-bf12-4ecc-a6e1-b87582b20f86-kube-api-access-4gzr6\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:53:11.603890 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.603851 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pps4d\" (UniqueName: \"kubernetes.io/projected/8328c2d0-1c49-4619-8ccc-4a238ce29121-kube-api-access-pps4d\") pod \"kas-connection-checker-685895c7c9-bqtvv\" (UID: \"8328c2d0-1c49-4619-8ccc-4a238ce29121\") " pod="kube-system/kas-connection-checker-685895c7c9-bqtvv" Oct 30 21:53:11.604122 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.604099 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb8pz\" (UniqueName: \"kubernetes.io/projected/3cfcee7d-4a08-441e-874b-5486b381d0f2-kube-api-access-bb8pz\") pod \"insights-operator-7c4986d449-frqg6\" (UID: \"3cfcee7d-4a08-441e-874b-5486b381d0f2\") " pod="openshift-insights/insights-operator-7c4986d449-frqg6" Oct 30 21:53:11.604410 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.604393 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z22xr\" (UniqueName: \"kubernetes.io/projected/3444842c-2f38-409f-ba87-e21af956df52-kube-api-access-z22xr\") pod \"network-check-source-6f78d59f99-rsx79\" (UID: \"3444842c-2f38-409f-ba87-e21af956df52\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rsx79" Oct 30 21:53:11.608403 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.608388 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lx28\" (UniqueName: \"kubernetes.io/projected/cc3ee40a-be4e-476f-91ff-a0cd164812fc-kube-api-access-2lx28\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:11.612016 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.611999 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-984vh\" (UniqueName: \"kubernetes.io/projected/6f371722-dc8f-48eb-8f8c-28f394ef4360-kube-api-access-984vh\") pod \"volume-data-source-validator-58c9f5f46d-l9ktm\" (UID: \"6f371722-dc8f-48eb-8f8c-28f394ef4360\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-l9ktm" Oct 30 21:53:11.660823 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.660806 5052 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:11.660985 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.660970 5052 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:11.667444 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.667426 5052 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 21:53:11.674257 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.674236 5052 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:53:11.674345 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:11.674278 5052 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:11.675197 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.675184 5052 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:53:11.675258 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:11.675218 5052 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-139.us-east-2.compute.internal" Oct 30 21:53:11.689340 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689319 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dqrt\" (UniqueName: \"kubernetes.io/projected/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-api-access-9dqrt\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:11.689415 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689351 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-device-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.689415 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689368 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-var-lib-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.689415 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689384 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/937459e4-a573-4d05-980b-b8c42db410f3-etc-tuned\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.689557 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689436 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-installation-pull-secrets\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.689557 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689470 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/937459e4-a573-4d05-980b-b8c42db410f3-etc-tuned\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.689557 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689527 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/181f4022-4f53-4e23-8424-01f6b5e06ec6-cert\") pod \"ingress-canary-sgzrz\" (UID: \"181f4022-4f53-4e23-8424-01f6b5e06ec6\") " pod="openshift-ingress-canary/ingress-canary-sgzrz" Oct 30 21:53:11.689709 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689560 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-host\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:53:11.689709 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689622 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m25k7\" (UniqueName: \"kubernetes.io/projected/187603a7-5181-4c01-b7d2-3d7a56796255-kube-api-access-m25k7\") pod \"migrator-66df5d496b-lhvx9\" (UID: \"187603a7-5181-4c01-b7d2-3d7a56796255\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lhvx9" Oct 30 21:53:11.689709 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689694 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-modprobe-d\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.689837 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689726 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-registration-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.689837 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689728 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/181f4022-4f53-4e23-8424-01f6b5e06ec6-cert\") pod \"ingress-canary-sgzrz\" (UID: \"181f4022-4f53-4e23-8424-01f6b5e06ec6\") " pod="openshift-ingress-canary/ingress-canary-sgzrz" Oct 30 21:53:11.689837 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689766 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-cnibin\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.689837 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689782 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-installation-pull-secrets\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.689837 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689790 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-iptables-alerter-script\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:53:11.690027 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689875 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-host-slash\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:53:11.690027 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689905 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-slash\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.690027 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689929 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.690027 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.689954 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-signing-cabundle\") pod \"service-ca-5fffc97bdf-d9ljx\" (UID: \"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:11.690027 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690001 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-systemd-units\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.690219 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690028 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl2sc\" (UniqueName: \"kubernetes.io/projected/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-kube-api-access-jl2sc\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:53:11.690219 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690042 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-iptables-alerter-script\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:53:11.690219 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690055 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:53:11.690219 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690095 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.690219 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690179 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-signing-cabundle\") pod \"service-ca-5fffc97bdf-d9ljx\" (UID: \"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:11.690219 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690185 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d901cac-9d8d-48f8-b1a6-61ae43d46721-config-volume\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:11.690219 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690215 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:53:11.690559 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690239 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovnkube-script-lib\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.690559 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690264 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:53:11.690559 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690288 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-signing-key\") pod \"service-ca-5fffc97bdf-d9ljx\" (UID: \"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:11.690559 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690314 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-certificates\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.690559 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690348 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d901cac-9d8d-48f8-b1a6-61ae43d46721-config-volume\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:11.690559 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690372 5052 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 21:53:11.690559 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690455 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-certificates\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.690559 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690487 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-multus-certs\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.690559 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690512 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:11.690559 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690538 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-tmp-dir\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:53:11.690559 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690539 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovnkube-script-lib\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.690559 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690538 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/967b7974-ef9d-4eff-8265-879c05e6fc96-original-pull-secret\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:53:11.690559 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690544 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-signing-key\") pod \"service-ca-5fffc97bdf-d9ljx\" (UID: \"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690587 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690606 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-tmp-dir\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690614 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-system-cni-dir\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690654 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-hostroot\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690684 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-kubernetes\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690709 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690731 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-netns\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690759 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-kubelet\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690811 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-node-log\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690899 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-run\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690926 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-conf-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.690953 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691023 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c7wj\" (UniqueName: \"kubernetes.io/projected/f2746830-9846-4bb6-afc2-713e6a5cd2e8-kube-api-access-8c7wj\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691030 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691073 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.691152 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691131 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx6dh\" (UniqueName: \"kubernetes.io/projected/cfb5127e-d35c-4d71-9565-b8044e41f2bc-kube-api-access-sx6dh\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691175 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-socket-dir-parent\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691203 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-cni-netd\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691230 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovn-node-metrics-cert\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691255 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j794x\" (UniqueName: \"kubernetes.io/projected/4873d347-3f18-4861-986e-15785bfd25c3-kube-api-access-j794x\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691281 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-cni-bin\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691326 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysctl-conf\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691434 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cnibin\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691459 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovn-node-metrics-cert\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691502 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-cni-multus\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691542 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87f7c\" (UniqueName: \"kubernetes.io/projected/daafa095-7904-4d87-ad51-83577c6d1452-kube-api-access-87f7c\") pod \"migrator-66df5d496b-bl46l\" (UID: \"daafa095-7904-4d87-ad51-83577c6d1452\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bl46l" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691567 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt255\" (UniqueName: \"kubernetes.io/projected/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-kube-api-access-vt255\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691591 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xcw4\" (UniqueName: \"kubernetes.io/projected/754f74c1-4a21-4497-bdb6-9b8b1e97842a-kube-api-access-2xcw4\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691608 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/937459e4-a573-4d05-980b-b8c42db410f3-tmp\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691622 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-cni-binary-copy\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691645 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysconfig\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691679 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-bound-sa-token\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691705 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-etc-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691726 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/937459e4-a573-4d05-980b-b8c42db410f3-tmp\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691731 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-lib-modules\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.691936 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691904 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-sys-fs\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691954 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/f2746830-9846-4bb6-afc2-713e6a5cd2e8-archives-path\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.691981 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692044 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovnkube-config\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692053 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-cni-binary-copy\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692058 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/f2746830-9846-4bb6-afc2-713e6a5cd2e8-archives-path\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692085 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysctl-d\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692120 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf456\" (UniqueName: \"kubernetes.io/projected/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-kube-api-access-vf456\") pod \"service-ca-5fffc97bdf-d9ljx\" (UID: \"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692166 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-service-ca-bundle\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692193 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-daemon-config\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692247 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-ovnkube-config\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692349 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-system-cni-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692356 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-service-ca-bundle\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692375 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-cni-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692388 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-daemon-config\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692426 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-kubelet\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692472 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-systemd\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692504 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692574 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-4fs6t\" (UID: \"38da3026-ac7f-44af-aa6c-f16cf3082c9e\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692606 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-systemd\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692708 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692746 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9ln7\" (UniqueName: \"kubernetes.io/projected/3d901cac-9d8d-48f8-b1a6-61ae43d46721-kube-api-access-q9ln7\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692773 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-env-overrides\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.692807 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692813 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmdvf\" (UniqueName: \"kubernetes.io/projected/937459e4-a573-4d05-980b-b8c42db410f3-kube-api-access-bmdvf\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692842 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-ca-trust-extracted\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692881 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcwnh\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-kube-api-access-vcwnh\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692908 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-cni-bin\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692920 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/754f74c1-4a21-4497-bdb6-9b8b1e97842a-env-overrides\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692960 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-etc-kubernetes\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.692985 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-ca-trust-extracted\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693128 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-sys\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693162 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9cqn\" (UniqueName: \"kubernetes.io/projected/181f4022-4f53-4e23-8424-01f6b5e06ec6-kube-api-access-x9cqn\") pod \"ingress-canary-sgzrz\" (UID: \"181f4022-4f53-4e23-8424-01f6b5e06ec6\") " pod="openshift-ingress-canary/ingress-canary-sgzrz" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693206 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/967b7974-ef9d-4eff-8265-879c05e6fc96-kubelet-config\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693253 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-trusted-ca\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693279 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693330 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-serviceca\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693400 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693429 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9101efec-ec15-4f30-929d-a3bcfd851caa-crio-socket\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693473 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/967b7974-ef9d-4eff-8265-879c05e6fc96-dbus\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693500 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693530 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-trusted-ca-bundle\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693635 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-trusted-ca\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693711 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-k8s-cni-cncf-io\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693738 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-run-ovn-kubernetes\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693764 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-var-lib-kubelet\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693790 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-hosts-file\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693819 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-image-registry-private-configuration\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.694009 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.693849 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cni-binary-copy\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694083 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-image-registry-private-configuration\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694136 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62fhs\" (UniqueName: \"kubernetes.io/projected/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-kube-api-access-62fhs\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694163 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-log-socket\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694188 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d901cac-9d8d-48f8-b1a6-61ae43d46721-tmp-dir\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694212 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-socket-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694237 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8rqr\" (UniqueName: \"kubernetes.io/projected/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-kube-api-access-s8rqr\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694262 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-run-netns\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694294 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls\") pod \"image-registry-6585488f54-nw2ht\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694340 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694372 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9101efec-ec15-4f30-929d-a3bcfd851caa-data-volume\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694395 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-host\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694431 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgp75\" (UniqueName: \"kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75\") pod \"network-check-target-dxkrb\" (UID: \"c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b\") " pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694604 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694660 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694689 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-ovn\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694899 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3ee40a-be4e-476f-91ff-a0cd164812fc-service-ca-bundle\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.694968 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cni-binary-copy\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.695011 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d901cac-9d8d-48f8-b1a6-61ae43d46721-tmp-dir\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.695071 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9101efec-ec15-4f30-929d-a3bcfd851caa-data-volume\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:11.695215 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.695215 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38da3026-ac7f-44af-aa6c-f16cf3082c9e-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-4fs6t\" (UID: \"38da3026-ac7f-44af-aa6c-f16cf3082c9e\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:53:11.696338 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.695249 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-trusted-ca-bundle\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:11.696338 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:11.695323 5052 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 21:53:11.696338 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.695803 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c41902e8-bf12-4ecc-a6e1-b87582b20f86-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kgnrh\" (UID: \"c41902e8-bf12-4ecc-a6e1-b87582b20f86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:53:11.696338 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.696140 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6b30cd9-d376-4e9e-8f95-d4d2c504cd93-metrics-certs\") pod \"network-metrics-daemon-ztlk7\" (UID: \"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93\") " pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:53:11.696338 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:11.696184 5052 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs podName:cc3ee40a-be4e-476f-91ff-a0cd164812fc nodeName:}" failed. No retries permitted until 2026-10-30 21:53:12.195376359 +0000 UTC m=+1.718417086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs") pod "router-default-6c8767fbdc-sxmpb" (UID: "cc3ee40a-be4e-476f-91ff-a0cd164812fc") : secret "router-metrics-certs-default" not found Oct 30 21:53:11.696338 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.696244 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-serviceca\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:53:11.696907 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.696875 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4846560b-5370-4fa1-8d36-43dfc4011191-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-d6jlp\" (UID: \"4846560b-5370-4fa1-8d36-43dfc4011191\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:53:11.701586 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.701564 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dqrt\" (UniqueName: \"kubernetes.io/projected/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-api-access-9dqrt\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:11.705317 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.705300 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c7wj\" (UniqueName: \"kubernetes.io/projected/f2746830-9846-4bb6-afc2-713e6a5cd2e8-kube-api-access-8c7wj\") pod \"periodic-gathering-lzjkn-79bnz\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:11.705407 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.705339 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt255\" (UniqueName: \"kubernetes.io/projected/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-kube-api-access-vt255\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:53:11.705843 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.705819 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87f7c\" (UniqueName: \"kubernetes.io/projected/daafa095-7904-4d87-ad51-83577c6d1452-kube-api-access-87f7c\") pod \"migrator-66df5d496b-bl46l\" (UID: \"daafa095-7904-4d87-ad51-83577c6d1452\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bl46l" Oct 30 21:53:11.706129 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.706110 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j794x\" (UniqueName: \"kubernetes.io/projected/4873d347-3f18-4861-986e-15785bfd25c3-kube-api-access-j794x\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.708760 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.708742 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgp75\" (UniqueName: \"kubernetes.io/projected/c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b-kube-api-access-zgp75\") pod \"network-check-target-dxkrb\" (UID: \"c68f1e16-d0d1-49a8-ab35-a9ce2c4a8c2b\") " pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:53:11.709865 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.709839 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9cqn\" (UniqueName: \"kubernetes.io/projected/181f4022-4f53-4e23-8424-01f6b5e06ec6-kube-api-access-x9cqn\") pod \"ingress-canary-sgzrz\" (UID: \"181f4022-4f53-4e23-8424-01f6b5e06ec6\") " pod="openshift-ingress-canary/ingress-canary-sgzrz" Oct 30 21:53:11.710448 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.710432 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcwnh\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-kube-api-access-vcwnh\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.710932 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.710909 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m25k7\" (UniqueName: \"kubernetes.io/projected/187603a7-5181-4c01-b7d2-3d7a56796255-kube-api-access-m25k7\") pod \"migrator-66df5d496b-lhvx9\" (UID: \"187603a7-5181-4c01-b7d2-3d7a56796255\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lhvx9" Oct 30 21:53:11.711026 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.711003 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xcw4\" (UniqueName: \"kubernetes.io/projected/754f74c1-4a21-4497-bdb6-9b8b1e97842a-kube-api-access-2xcw4\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.711204 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.711186 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9ln7\" (UniqueName: \"kubernetes.io/projected/3d901cac-9d8d-48f8-b1a6-61ae43d46721-kube-api-access-q9ln7\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:11.711476 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.711457 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmdvf\" (UniqueName: \"kubernetes.io/projected/937459e4-a573-4d05-980b-b8c42db410f3-kube-api-access-bmdvf\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.713190 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.713165 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-bound-sa-token\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.713317 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.713295 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx6dh\" (UniqueName: \"kubernetes.io/projected/cfb5127e-d35c-4d71-9565-b8044e41f2bc-kube-api-access-sx6dh\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.713394 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.713330 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl2sc\" (UniqueName: \"kubernetes.io/projected/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-kube-api-access-jl2sc\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:53:11.713475 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.713460 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf456\" (UniqueName: \"kubernetes.io/projected/40aa6e8d-b731-4ab3-990c-8e9cb8bd582b-kube-api-access-vf456\") pod \"service-ca-5fffc97bdf-d9ljx\" (UID: \"40aa6e8d-b731-4ab3-990c-8e9cb8bd582b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-d9ljx" Oct 30 21:53:11.718623 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.718602 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62fhs\" (UniqueName: \"kubernetes.io/projected/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-kube-api-access-62fhs\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.718823 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.718796 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8rqr\" (UniqueName: \"kubernetes.io/projected/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-kube-api-access-s8rqr\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:53:11.719597 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.719573 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:11.795587 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795555 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-system-cni-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.795724 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795588 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-cni-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.795724 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795610 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-kubelet\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.795724 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795632 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-systemd\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.795724 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795676 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-system-cni-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.795724 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795685 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-kubelet\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.795724 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795691 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-systemd\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.795724 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795712 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-systemd\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.795724 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795692 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-cni-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795745 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-cni-bin\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795768 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-etc-kubernetes\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795797 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-systemd\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795810 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-cni-bin\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795816 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-etc-kubernetes\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795868 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-sys\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795897 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/967b7974-ef9d-4eff-8265-879c05e6fc96-kubelet-config\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795920 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795943 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9101efec-ec15-4f30-929d-a3bcfd851caa-crio-socket\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795955 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/967b7974-ef9d-4eff-8265-879c05e6fc96-kubelet-config\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795956 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-sys\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795964 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/967b7974-ef9d-4eff-8265-879c05e6fc96-dbus\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.795989 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796011 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-k8s-cni-cncf-io\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796015 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/967b7974-ef9d-4eff-8265-879c05e6fc96-dbus\") pod \"global-pull-secret-syncer-s5jhm\" (UID: \"967b7974-ef9d-4eff-8265-879c05e6fc96\") " pod="kube-system/global-pull-secret-syncer-s5jhm" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796021 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9101efec-ec15-4f30-929d-a3bcfd851caa-crio-socket\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796041 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-k8s-cni-cncf-io\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796042 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-run-ovn-kubernetes\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796068 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-var-lib-kubelet\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.796097 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796091 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-hosts-file\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796119 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-var-lib-kubelet\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796131 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-log-socket\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796136 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d4e36e4-7ca2-4e4f-837d-ebdef77734b1-hosts-file\") pod \"node-resolver-4d225\" (UID: \"4d4e36e4-7ca2-4e4f-837d-ebdef77734b1\") " pod="openshift-dns/node-resolver-4d225" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796092 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-run-ovn-kubernetes\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796155 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-socket-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796174 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-log-socket\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796180 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-run-netns\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796199 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-run-netns\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796199 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796210 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-socket-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796229 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-host\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796238 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796257 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796271 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-ovn\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796288 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-device-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796313 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-var-lib-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796331 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-device-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796331 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-ovn\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796339 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-host\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796283 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-host\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796374 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a-host\") pod \"node-ca-dgfl4\" (UID: \"dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a\") " pod="openshift-image-registry/node-ca-dgfl4" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796363 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-modprobe-d\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796373 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-var-lib-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796435 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-modprobe-d\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796523 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-registration-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796540 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-registration-dir\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796557 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-cnibin\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796582 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-host-slash\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796605 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-slash\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796629 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796651 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e23d7533-e36d-460f-b8f4-18d4f38dd0e7-host-slash\") pod \"iptables-alerter-npvbd\" (UID: \"e23d7533-e36d-460f-b8f4-18d4f38dd0e7\") " pod="openshift-network-operator/iptables-alerter-npvbd" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796656 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-cnibin\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796654 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-systemd-units\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796672 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-slash\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796686 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796689 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-systemd-units\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796711 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-multus-certs\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796692 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-multus-certs\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796752 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796768 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796787 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-system-cni-dir\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796802 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-hostroot\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:11.796814 5052 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796843 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-kubernetes\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796816 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-kubernetes\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796882 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-hostroot\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:11.796887 5052 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm podName:9101efec-ec15-4f30-929d-a3bcfd851caa nodeName:}" failed. No retries permitted until 2026-10-30 21:53:12.296871419 +0000 UTC m=+1.819912152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rgkfs" (UID: "9101efec-ec15-4f30-929d-a3bcfd851caa") : configmap "kube-rbac-proxy" not found Oct 30 21:53:11.796887 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796881 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-system-cni-dir\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:11.796919 5052 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796923 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-netns\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796940 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-kubelet\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:11.796966 5052 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls podName:3d901cac-9d8d-48f8-b1a6-61ae43d46721 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:12.296954091 +0000 UTC m=+1.819994806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls") pod "dns-default-sq7zn" (UID: "3d901cac-9d8d-48f8-b1a6-61ae43d46721") : secret "dns-default-metrics-tls" not found Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796957 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-node-log\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796985 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-node-log\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.796998 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-run\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797002 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-run-netns\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797021 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-conf-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797007 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-kubelet\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797049 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-conf-dir\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797049 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797055 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-run\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797076 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797099 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-socket-dir-parent\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:11.797107 5052 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797113 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-cni-netd\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797128 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-cni-bin\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:11.797141 5052 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls podName:9101efec-ec15-4f30-929d-a3bcfd851caa nodeName:}" failed. No retries permitted until 2026-10-30 21:53:12.297129853 +0000 UTC m=+1.820170572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rgkfs" (UID: "9101efec-ec15-4f30-929d-a3bcfd851caa") : secret "insights-runtime-extractor-tls" not found Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797158 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysctl-conf\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797159 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-cni-bin\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797176 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-multus-socket-dir-parent\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797186 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cnibin\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797199 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797210 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-cni-multus\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797217 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-host-cni-netd\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797242 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfb5127e-d35c-4d71-9565-b8044e41f2bc-cnibin\") pod \"multus-additional-cni-plugins-vpw8h\" (UID: \"cfb5127e-d35c-4d71-9565-b8044e41f2bc\") " pod="openshift-multus/multus-additional-cni-plugins-vpw8h" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797245 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysconfig\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797245 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d30d11f1-faf2-4cf7-8d92-7bdda003b7c1-host-var-lib-cni-multus\") pod \"multus-7s4gp\" (UID: \"d30d11f1-faf2-4cf7-8d92-7bdda003b7c1\") " pod="openshift-multus/multus-7s4gp" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797253 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysctl-conf\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797272 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-etc-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797295 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-lib-modules\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797311 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysconfig\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797317 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-sys-fs\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797336 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-etc-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797355 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797363 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4873d347-3f18-4861-986e-15785bfd25c3-sys-fs\") pod \"aws-ebs-csi-driver-node-qrdww\" (UID: \"4873d347-3f18-4861-986e-15785bfd25c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrdww" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797381 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysctl-d\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797398 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-lib-modules\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797404 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/754f74c1-4a21-4497-bdb6-9b8b1e97842a-run-openvswitch\") pod \"ovnkube-node-d75zh\" (UID: \"754f74c1-4a21-4497-bdb6-9b8b1e97842a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:11.798391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.797518 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/937459e4-a573-4d05-980b-b8c42db410f3-etc-sysctl-d\") pod \"tuned-hchhj\" (UID: \"937459e4-a573-4d05-980b-b8c42db410f3\") " pod="openshift-cluster-node-tuning-operator/tuned-hchhj" Oct 30 21:53:11.799563 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.798610 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls\") pod \"image-registry-7b99f4cc75-7drms\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.862684 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.862625 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" Oct 30 21:53:11.862778 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.862723 5052 scope.go:122] "RemoveContainer" containerID="0460225e186b8a286a1732a9d921f46e9978325a451def36afdb4689d7eb8151" Oct 30 21:53:11.863656 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.863639 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" Oct 30 21:53:11.864884 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.864866 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:11.865845 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.865831 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" Oct 30 21:53:11.866937 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.866921 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ztlk7" Oct 30 21:53:11.877748 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.877732 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:11.896326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:11.896295 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:12.163329 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.163232 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp"] Oct 30 21:53:12.166765 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:12.166737 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4846560b_5370_4fa1_8d36_43dfc4011191.slice/crio-7366de34ab45feb825083404f9589b3f35f1fc838b99575f77dd13883da70b75 WatchSource:0}: Error finding container 7366de34ab45feb825083404f9589b3f35f1fc838b99575f77dd13883da70b75: Status 404 returned error can't find the container with id 7366de34ab45feb825083404f9589b3f35f1fc838b99575f77dd13883da70b75 Oct 30 21:53:12.168941 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.168926 5052 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 21:53:12.184135 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.184114 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh"] Oct 30 21:53:12.201776 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.201755 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:12.204181 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.204160 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc3ee40a-be4e-476f-91ff-a0cd164812fc-metrics-certs\") pod \"router-default-6c8767fbdc-sxmpb\" (UID: \"cc3ee40a-be4e-476f-91ff-a0cd164812fc\") " pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:12.214291 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.214265 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b99f4cc75-7drms"] Oct 30 21:53:12.217693 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:12.217654 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca45dcf_d2cd_4797_be23_47d5ac33b57b.slice/crio-5d19e8f6efb1ee41a238aef730f361a06aebd466175a6c726a93ccccc5e4a2df WatchSource:0}: Error finding container 5d19e8f6efb1ee41a238aef730f361a06aebd466175a6c726a93ccccc5e4a2df: Status 404 returned error can't find the container with id 5d19e8f6efb1ee41a238aef730f361a06aebd466175a6c726a93ccccc5e4a2df Oct 30 21:53:12.257795 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.257772 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6585488f54-nw2ht"] Oct 30 21:53:12.268995 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:12.268965 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012b8527_ec34_4639_b76c_5f941b31d02d.slice/crio-ab0813b56a7d7d241c315268db3d3b02d8ffa2ffbfa693bc1f19e671f2703756 WatchSource:0}: Error finding container ab0813b56a7d7d241c315268db3d3b02d8ffa2ffbfa693bc1f19e671f2703756: Status 404 returned error can't find the container with id ab0813b56a7d7d241c315268db3d3b02d8ffa2ffbfa693bc1f19e671f2703756 Oct 30 21:53:12.279425 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.279402 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-4fs6t"] Oct 30 21:53:12.282155 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.282130 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ztlk7"] Oct 30 21:53:12.283028 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:12.283000 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38da3026_ac7f_44af_aa6c_f16cf3082c9e.slice/crio-e9f3660c002568e70721f1a3f2c3e096bc3e297cd88b46e15eea4bf4760cb915 WatchSource:0}: Error finding container e9f3660c002568e70721f1a3f2c3e096bc3e297cd88b46e15eea4bf4760cb915: Status 404 returned error can't find the container with id e9f3660c002568e70721f1a3f2c3e096bc3e297cd88b46e15eea4bf4760cb915 Oct 30 21:53:12.286179 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:12.286159 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b30cd9_d376_4e9e_8f95_d4d2c504cd93.slice/crio-ac82ffe53c44c388f531d25d629d113913447bbd512439a9a569573c783bc97c WatchSource:0}: Error finding container ac82ffe53c44c388f531d25d629d113913447bbd512439a9a569573c783bc97c: Status 404 returned error can't find the container with id ac82ffe53c44c388f531d25d629d113913447bbd512439a9a569573c783bc97c Oct 30 21:53:12.302275 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.302252 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:12.302387 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.302286 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:12.302387 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.302310 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:12.302387 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:12.302373 5052 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 21:53:12.302547 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:12.302407 5052 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 21:53:12.302547 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:12.302416 5052 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 21:53:12.302547 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:12.302429 5052 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm podName:9101efec-ec15-4f30-929d-a3bcfd851caa nodeName:}" failed. No retries permitted until 2026-10-30 21:53:13.302412563 +0000 UTC m=+2.825453273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rgkfs" (UID: "9101efec-ec15-4f30-929d-a3bcfd851caa") : configmap "kube-rbac-proxy" not found Oct 30 21:53:12.302547 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:12.302449 5052 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls podName:3d901cac-9d8d-48f8-b1a6-61ae43d46721 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:13.30243824 +0000 UTC m=+2.825478953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls") pod "dns-default-sq7zn" (UID: "3d901cac-9d8d-48f8-b1a6-61ae43d46721") : secret "dns-default-metrics-tls" not found Oct 30 21:53:12.302547 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:12.302462 5052 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls podName:9101efec-ec15-4f30-929d-a3bcfd851caa nodeName:}" failed. No retries permitted until 2026-10-30 21:53:13.302456159 +0000 UTC m=+2.825496870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rgkfs" (UID: "9101efec-ec15-4f30-929d-a3bcfd851caa") : secret "insights-runtime-extractor-tls" not found Oct 30 21:53:12.308502 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.308477 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:12.463492 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.463412 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:12.558445 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.558400 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:12.673553 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.673492 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6585488f54-nw2ht" event={"ID":"012b8527-ec34-4639-b76c-5f941b31d02d","Type":"ContainerStarted","Data":"5fd2b832df17fafe4c6cbf59b9e3282c28ce73033cde3f16e928b4c4c24f5eaf"} Oct 30 21:53:12.673800 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.673616 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6585488f54-nw2ht" event={"ID":"012b8527-ec34-4639-b76c-5f941b31d02d","Type":"ContainerStarted","Data":"ab0813b56a7d7d241c315268db3d3b02d8ffa2ffbfa693bc1f19e671f2703756"} Oct 30 21:53:12.674906 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.674877 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" event={"ID":"c41902e8-bf12-4ecc-a6e1-b87582b20f86","Type":"ContainerStarted","Data":"eac37173b3305f15f8223c202f2a63d8e67c82111453d472ebe023d9c7d3e3ce"} Oct 30 21:53:12.676228 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.676203 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" event={"ID":"4846560b-5370-4fa1-8d36-43dfc4011191","Type":"ContainerStarted","Data":"7366de34ab45feb825083404f9589b3f35f1fc838b99575f77dd13883da70b75"} Oct 30 21:53:12.677307 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.677288 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" event={"ID":"38da3026-ac7f-44af-aa6c-f16cf3082c9e","Type":"ContainerStarted","Data":"e9f3660c002568e70721f1a3f2c3e096bc3e297cd88b46e15eea4bf4760cb915"} Oct 30 21:53:12.679749 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.679725 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" event={"ID":"9ca45dcf-d2cd-4797-be23-47d5ac33b57b","Type":"ContainerStarted","Data":"2b1888be5694898bc4d3e9b6a8c6ea4dceea618eb5bf8e6ddf749d4c57d078b7"} Oct 30 21:53:12.679833 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.679770 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" event={"ID":"9ca45dcf-d2cd-4797-be23-47d5ac33b57b","Type":"ContainerStarted","Data":"5d19e8f6efb1ee41a238aef730f361a06aebd466175a6c726a93ccccc5e4a2df"} Oct 30 21:53:12.679833 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.679806 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:12.681817 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.681786 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 21:53:12.682358 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.682333 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/1.log" Oct 30 21:53:12.682454 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.682368 5052 generic.go:356] "Generic (PLEG): container finished" podID="7c068922-cad3-472a-a20a-890955ecb231" containerID="e137c34a97fcd34dbf1eeecd3a7ef99acd88e105fbb550265accd0faaf32b3db" exitCode=255 Oct 30 21:53:12.682514 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.682447 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" event={"ID":"7c068922-cad3-472a-a20a-890955ecb231","Type":"ContainerDied","Data":"e137c34a97fcd34dbf1eeecd3a7ef99acd88e105fbb550265accd0faaf32b3db"} Oct 30 21:53:12.682514 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.682490 5052 scope.go:122] "RemoveContainer" containerID="0460225e186b8a286a1732a9d921f46e9978325a451def36afdb4689d7eb8151" Oct 30 21:53:12.682869 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.682838 5052 scope.go:122] "RemoveContainer" containerID="e137c34a97fcd34dbf1eeecd3a7ef99acd88e105fbb550265accd0faaf32b3db" Oct 30 21:53:12.683108 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:12.683085 5052 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-hn7m5_openshift-console-operator(7c068922-cad3-472a-a20a-890955ecb231)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" podUID="7c068922-cad3-472a-a20a-890955ecb231" Oct 30 21:53:12.684304 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.684282 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ztlk7" event={"ID":"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93","Type":"ContainerStarted","Data":"ac82ffe53c44c388f531d25d629d113913447bbd512439a9a569573c783bc97c"} Oct 30 21:53:12.754218 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.754190 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c8767fbdc-sxmpb"] Oct 30 21:53:12.758268 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:12.758241 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc3ee40a_be4e_476f_91ff_a0cd164812fc.slice/crio-4af6dc8ded48a53dc342ec80e4da5e9e9decc5058ef222cffbe25d4051cef811 WatchSource:0}: Error finding container 4af6dc8ded48a53dc342ec80e4da5e9e9decc5058ef222cffbe25d4051cef811: Status 404 returned error can't find the container with id 4af6dc8ded48a53dc342ec80e4da5e9e9decc5058ef222cffbe25d4051cef811 Oct 30 21:53:12.920974 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.920918 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:12.984209 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:12.984131 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:13.112602 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:13.112568 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:13.312917 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:13.312836 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:13.312917 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:13.312893 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:13.312917 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:13.312919 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:13.313119 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:13.313048 5052 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 21:53:13.313119 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:13.313094 5052 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls podName:9101efec-ec15-4f30-929d-a3bcfd851caa nodeName:}" failed. No retries permitted until 2026-10-30 21:53:15.313082104 +0000 UTC m=+4.836122828 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rgkfs" (UID: "9101efec-ec15-4f30-929d-a3bcfd851caa") : secret "insights-runtime-extractor-tls" not found Oct 30 21:53:13.313382 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:13.313363 5052 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 21:53:13.313460 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:13.313406 5052 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm podName:9101efec-ec15-4f30-929d-a3bcfd851caa nodeName:}" failed. No retries permitted until 2026-10-30 21:53:15.313396192 +0000 UTC m=+4.836436917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rgkfs" (UID: "9101efec-ec15-4f30-929d-a3bcfd851caa") : configmap "kube-rbac-proxy" not found Oct 30 21:53:13.313460 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:13.313454 5052 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 21:53:13.313561 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:13.313473 5052 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls podName:3d901cac-9d8d-48f8-b1a6-61ae43d46721 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:15.313467443 +0000 UTC m=+4.836508167 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls") pod "dns-default-sq7zn" (UID: "3d901cac-9d8d-48f8-b1a6-61ae43d46721") : secret "dns-default-metrics-tls" not found Oct 30 21:53:13.517577 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:13.517519 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:13.620910 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:13.620847 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:13.691830 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:13.691801 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" event={"ID":"cc3ee40a-be4e-476f-91ff-a0cd164812fc","Type":"ContainerStarted","Data":"9d465240576c68004d507bd619c8b68f655372063fb8b69fcee7678751ad1a0d"} Oct 30 21:53:13.691986 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:13.691848 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" event={"ID":"cc3ee40a-be4e-476f-91ff-a0cd164812fc","Type":"ContainerStarted","Data":"4af6dc8ded48a53dc342ec80e4da5e9e9decc5058ef222cffbe25d4051cef811"} Oct 30 21:53:13.694015 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:13.693989 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 21:53:13.734210 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:13.734183 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:14.351405 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.351368 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:14.464049 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.464014 5052 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:14.466747 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.466727 5052 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:14.602282 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.602253 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:14.699642 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.699617 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" event={"ID":"c41902e8-bf12-4ecc-a6e1-b87582b20f86","Type":"ContainerStarted","Data":"07617c81c7e1bfd08b83e24d1ba0c59fc24ce9e7a403f754f99d6a52848241bb"} Oct 30 21:53:14.701105 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.701081 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-d6jlp" event={"ID":"4846560b-5370-4fa1-8d36-43dfc4011191","Type":"ContainerStarted","Data":"98479a09dedf489b09dacd5772cbc0261bc1128f67eecbb8cf8262d11ef34fa8"} Oct 30 21:53:14.702661 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.702634 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:14.702758 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.702691 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-4fs6t" event={"ID":"38da3026-ac7f-44af-aa6c-f16cf3082c9e","Type":"ContainerStarted","Data":"57cf5e794bc9fe09742baefc78038b4c4dd7e3bb7649bc5ab75d66b48046c509"} Oct 30 21:53:14.704412 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.704388 5052 generic.go:356] "Generic (PLEG): container finished" podID="3cfcee7d-4a08-441e-874b-5486b381d0f2" containerID="47e4c6ae9cabd43d1a3d7fa263fb931626773b0e97b536b0d9b1cfc1bf32f542" exitCode=0 Oct 30 21:53:14.704518 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.704450 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-frqg6" event={"ID":"3cfcee7d-4a08-441e-874b-5486b381d0f2","Type":"ContainerDied","Data":"47e4c6ae9cabd43d1a3d7fa263fb931626773b0e97b536b0d9b1cfc1bf32f542"} Oct 30 21:53:14.704762 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.704746 5052 scope.go:122] "RemoveContainer" containerID="47e4c6ae9cabd43d1a3d7fa263fb931626773b0e97b536b0d9b1cfc1bf32f542" Oct 30 21:53:14.706591 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.706573 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ztlk7" event={"ID":"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93","Type":"ContainerStarted","Data":"cf801f5e25ad9fabc08d44aeafd946afd5693546b52ee19b3ea6e1f8a830a112"} Oct 30 21:53:14.706680 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.706617 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ztlk7" event={"ID":"b6b30cd9-d376-4e9e-8f95-d4d2c504cd93","Type":"ContainerStarted","Data":"70b33b30a264f1a7c7f525e22fcc5e945d47b697589871a5d6353c1992089408"} Oct 30 21:53:14.708953 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.708935 5052 generic.go:356] "Generic (PLEG): container finished" podID="a4646859-cf39-4d6b-a2e2-f2795635390c" containerID="57cdbfcc8db6c5ae157e726ee05bba9d9443b165c4d3d7e003f0c4709f71a837" exitCode=0 Oct 30 21:53:14.709310 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.709295 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" event={"ID":"a4646859-cf39-4d6b-a2e2-f2795635390c","Type":"ContainerDied","Data":"57cdbfcc8db6c5ae157e726ee05bba9d9443b165c4d3d7e003f0c4709f71a837"} Oct 30 21:53:14.709491 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.709479 5052 scope.go:122] "RemoveContainer" containerID="57cdbfcc8db6c5ae157e726ee05bba9d9443b165c4d3d7e003f0c4709f71a837" Oct 30 21:53:14.830823 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.830720 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:14.908340 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.908309 5052 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:53:14.908702 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.908680 5052 scope.go:122] "RemoveContainer" containerID="e137c34a97fcd34dbf1eeecd3a7ef99acd88e105fbb550265accd0faaf32b3db" Oct 30 21:53:14.908937 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:14.908914 5052 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-hn7m5_openshift-console-operator(7c068922-cad3-472a-a20a-890955ecb231)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" podUID="7c068922-cad3-472a-a20a-890955ecb231" Oct 30 21:53:14.912447 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.912425 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:53:14.936302 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:14.936276 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:15.124507 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.124418 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:15.332455 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.332418 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:15.332455 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.332456 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:15.332654 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.332480 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:15.332654 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:15.332568 5052 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 21:53:15.332654 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:15.332621 5052 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls podName:9101efec-ec15-4f30-929d-a3bcfd851caa nodeName:}" failed. No retries permitted until 2026-10-30 21:53:19.33260839 +0000 UTC m=+8.855649101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rgkfs" (UID: "9101efec-ec15-4f30-929d-a3bcfd851caa") : secret "insights-runtime-extractor-tls" not found Oct 30 21:53:15.332962 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.332937 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9101efec-ec15-4f30-929d-a3bcfd851caa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:15.334680 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.334655 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d901cac-9d8d-48f8-b1a6-61ae43d46721-metrics-tls\") pod \"dns-default-sq7zn\" (UID: \"3d901cac-9d8d-48f8-b1a6-61ae43d46721\") " pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:15.479536 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.479506 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:15.516581 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.516552 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:15.689293 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.689264 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:53:15.714476 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.714442 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-frqg6" event={"ID":"3cfcee7d-4a08-441e-874b-5486b381d0f2","Type":"ContainerStarted","Data":"26904d698d9a0ae8201dcfeade33344aef121db8acfc79c4ad2878d18978cadc"} Oct 30 21:53:15.716454 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.716407 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-8xqzr" event={"ID":"a4646859-cf39-4d6b-a2e2-f2795635390c","Type":"ContainerStarted","Data":"8e584ff998e6f66731ade577b612dfb79a306f1d570581441bb5a443989158d8"} Oct 30 21:53:15.716995 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.716967 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:15.718443 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.718418 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kgnrh" event={"ID":"c41902e8-bf12-4ecc-a6e1-b87582b20f86","Type":"ContainerStarted","Data":"1806e993fe100c01845386953d4d93e548d610594b98e66bb4908c7edd7959a8"} Oct 30 21:53:15.718559 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.718467 5052 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 21:53:15.718935 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.718916 5052 scope.go:122] "RemoveContainer" containerID="e137c34a97fcd34dbf1eeecd3a7ef99acd88e105fbb550265accd0faaf32b3db" Oct 30 21:53:15.719146 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:15.719127 5052 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-hn7m5_openshift-console-operator(7c068922-cad3-472a-a20a-890955ecb231)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" podUID="7c068922-cad3-472a-a20a-890955ecb231" Oct 30 21:53:15.750474 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:15.750412 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sq7zn"] Oct 30 21:53:15.756916 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:15.756888 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d901cac_9d8d_48f8_b1a6_61ae43d46721.slice/crio-4d413027f446a249187c85420183a2b5c1ce21c567b039d6a890734cc4627a36 WatchSource:0}: Error finding container 4d413027f446a249187c85420183a2b5c1ce21c567b039d6a890734cc4627a36: Status 404 returned error can't find the container with id 4d413027f446a249187c85420183a2b5c1ce21c567b039d6a890734cc4627a36 Oct 30 21:53:16.305233 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:16.305193 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:16.724363 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:16.724284 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sq7zn" event={"ID":"3d901cac-9d8d-48f8-b1a6-61ae43d46721","Type":"ContainerStarted","Data":"4d413027f446a249187c85420183a2b5c1ce21c567b039d6a890734cc4627a36"} Oct 30 21:53:16.907678 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:16.907645 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:17.105425 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:17.105387 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:17.506007 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:17.505978 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:17.711712 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:17.711619 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:17.734246 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:17.734218 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sq7zn" event={"ID":"3d901cac-9d8d-48f8-b1a6-61ae43d46721","Type":"ContainerStarted","Data":"5eedee0599e24cc1f491c848a15d50842949df7d6714e8fd53f97bc3a37541f2"} Oct 30 21:53:17.734624 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:17.734285 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sq7zn" event={"ID":"3d901cac-9d8d-48f8-b1a6-61ae43d46721","Type":"ContainerStarted","Data":"17e0ad2c1c6e822ac26d4f6f15bc990afb4ee2c561d6252806e86c2ca00f07cc"} Oct 30 21:53:17.734624 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:17.734355 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:17.906507 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:17.906480 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:18.043605 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:18.043572 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:18.958567 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:18.958539 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:19.367841 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:19.367808 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:19.370105 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:19.370081 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9101efec-ec15-4f30-929d-a3bcfd851caa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rgkfs\" (UID: \"9101efec-ec15-4f30-929d-a3bcfd851caa\") " pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:19.381012 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:19.380992 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rgkfs" Oct 30 21:53:19.654850 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:19.654774 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rgkfs"] Oct 30 21:53:19.658701 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:19.658678 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9101efec_ec15_4f30_929d_a3bcfd851caa.slice/crio-caff15c3fca73b30c3f692e0e23f77f6ae24ee6ac022db8efa68eff4c67dbfd2 WatchSource:0}: Error finding container caff15c3fca73b30c3f692e0e23f77f6ae24ee6ac022db8efa68eff4c67dbfd2: Status 404 returned error can't find the container with id caff15c3fca73b30c3f692e0e23f77f6ae24ee6ac022db8efa68eff4c67dbfd2 Oct 30 21:53:19.747796 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:19.747762 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rgkfs" event={"ID":"9101efec-ec15-4f30-929d-a3bcfd851caa","Type":"ContainerStarted","Data":"18f2bccc9130bad22135dab8d72314390ef8241e2d9b2c3ee9d31222661fc809"} Oct 30 21:53:19.747937 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:19.747815 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rgkfs" event={"ID":"9101efec-ec15-4f30-929d-a3bcfd851caa","Type":"ContainerStarted","Data":"caff15c3fca73b30c3f692e0e23f77f6ae24ee6ac022db8efa68eff4c67dbfd2"} Oct 30 21:53:19.803101 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:19.803069 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:19.803269 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:19.803204 5052 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 21:53:19.804365 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:19.804344 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6c8767fbdc-sxmpb" Oct 30 21:53:20.759375 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:20.759342 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rgkfs" event={"ID":"9101efec-ec15-4f30-929d-a3bcfd851caa","Type":"ContainerStarted","Data":"5052b0c1edb240fc1981b73099cfb0b416e6e1b0732c6caf77daa0c528ab4479"} Oct 30 21:53:20.761057 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:20.761032 5052 generic.go:356] "Generic (PLEG): container finished" podID="3cfcee7d-4a08-441e-874b-5486b381d0f2" containerID="26904d698d9a0ae8201dcfeade33344aef121db8acfc79c4ad2878d18978cadc" exitCode=0 Oct 30 21:53:20.761191 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:20.761098 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-frqg6" event={"ID":"3cfcee7d-4a08-441e-874b-5486b381d0f2","Type":"ContainerDied","Data":"26904d698d9a0ae8201dcfeade33344aef121db8acfc79c4ad2878d18978cadc"} Oct 30 21:53:20.761191 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:20.761148 5052 scope.go:122] "RemoveContainer" containerID="47e4c6ae9cabd43d1a3d7fa263fb931626773b0e97b536b0d9b1cfc1bf32f542" Oct 30 21:53:20.761580 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:20.761558 5052 scope.go:122] "RemoveContainer" containerID="26904d698d9a0ae8201dcfeade33344aef121db8acfc79c4ad2878d18978cadc" Oct 30 21:53:20.761843 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:20.761819 5052 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"insights-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=insights-operator pod=insights-operator-7c4986d449-frqg6_openshift-insights(3cfcee7d-4a08-441e-874b-5486b381d0f2)\"" pod="openshift-insights/insights-operator-7c4986d449-frqg6" podUID="3cfcee7d-4a08-441e-874b-5486b381d0f2" Oct 30 21:53:20.850430 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:20.850402 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:20.850583 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:20.850570 5052 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 21:53:21.768206 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:21.768176 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rgkfs" event={"ID":"9101efec-ec15-4f30-929d-a3bcfd851caa","Type":"ContainerStarted","Data":"206380d420fed0fd5090998ed2c92d180d9d84d7627173921df9d2352b8a52ee"} Oct 30 21:53:23.123055 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:23.123017 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:23.234327 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:23.234290 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:24.602663 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:24.602629 5052 scope.go:122] "RemoveContainer" containerID="e137c34a97fcd34dbf1eeecd3a7ef99acd88e105fbb550265accd0faaf32b3db" Oct 30 21:53:24.785406 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:24.785380 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 21:53:24.785571 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:24.785435 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" event={"ID":"7c068922-cad3-472a-a20a-890955ecb231","Type":"ContainerStarted","Data":"770f92628df644126359c18da9034ae3fbedd914a65ddf0bde93149cbcfe375a"} Oct 30 21:53:24.785757 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:24.785733 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:53:24.901414 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:24.901322 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-hn7m5" Oct 30 21:53:25.131922 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:25.131888 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:25.242602 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:25.242566 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:25.344724 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:25.344690 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:25.635419 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:25.635335 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:25.722118 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:25.722097 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-25wb5" Oct 30 21:53:25.743141 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:25.743114 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:25.761282 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:25.761254 5052 patch_prober.go:29] interesting pod/image-registry-6585488f54-nw2ht container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Oct 30 21:53:25.761402 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:25.761305 5052 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6585488f54-nw2ht" podUID="012b8527-ec34-4639-b76c-5f941b31d02d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 21:53:26.115073 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.115040 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-6r7wl-wbxms"] Oct 30 21:53:26.118406 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.118387 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:26.134893 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.128751 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7hg"] Oct 30 21:53:26.134893 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.132272 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7hg" Oct 30 21:53:26.137296 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.137270 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-6r7wl-wbxms"] Oct 30 21:53:26.149957 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.149931 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7hg"] Oct 30 21:53:26.150199 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.150177 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-f5kzt\"" Oct 30 21:53:26.150309 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.150299 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Oct 30 21:53:26.156136 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.156112 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6585488f54-nw2ht"] Oct 30 21:53:26.221701 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.221674 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-service-ca-bundle\") pod \"periodic-gathering-6r7wl-wbxms\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:26.221847 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.221721 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-archives-path\") pod \"periodic-gathering-6r7wl-wbxms\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:26.221847 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.221824 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ef4d3c62-59b9-4127-ba60-06594bcf3c1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-kl7hg\" (UID: \"ef4d3c62-59b9-4127-ba60-06594bcf3c1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7hg" Oct 30 21:53:26.221981 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.221903 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-trusted-ca-bundle\") pod \"periodic-gathering-6r7wl-wbxms\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:26.221981 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.221929 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg6pw\" (UniqueName: \"kubernetes.io/projected/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-kube-api-access-gg6pw\") pod \"periodic-gathering-6r7wl-wbxms\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:26.229980 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.229959 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-f2tqb"] Oct 30 21:53:26.233402 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.233384 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9976cb5f8-znt8v"] Oct 30 21:53:26.233506 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.233490 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-f2tqb" Oct 30 21:53:26.236620 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.236600 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.242357 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.242337 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 30 21:53:26.242507 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.242480 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 30 21:53:26.244341 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.244267 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-hgjsb\"" Oct 30 21:53:26.250415 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.250363 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-f2tqb"] Oct 30 21:53:26.255870 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.255837 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9976cb5f8-znt8v"] Oct 30 21:53:26.291291 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.291261 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:26.322660 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.322634 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg6pw\" (UniqueName: \"kubernetes.io/projected/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-kube-api-access-gg6pw\") pod \"periodic-gathering-6r7wl-wbxms\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:26.322771 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.322671 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d61a3c1-7782-49be-9760-ec2025db2f82-tmp\") pod \"downloads-6dd789c8b7-f2tqb\" (UID: \"5d61a3c1-7782-49be-9760-ec2025db2f82\") " pod="openshift-console/downloads-6dd789c8b7-f2tqb" Oct 30 21:53:26.322771 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.322694 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdtrj\" (UniqueName: \"kubernetes.io/projected/5d61a3c1-7782-49be-9760-ec2025db2f82-kube-api-access-jdtrj\") pod \"downloads-6dd789c8b7-f2tqb\" (UID: \"5d61a3c1-7782-49be-9760-ec2025db2f82\") " pod="openshift-console/downloads-6dd789c8b7-f2tqb" Oct 30 21:53:26.322771 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.322719 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-bound-sa-token\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.322771 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.322744 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-service-ca-bundle\") pod \"periodic-gathering-6r7wl-wbxms\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:26.323037 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.322975 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-image-registry-private-configuration\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.323037 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.323011 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-registry-certificates\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.323135 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.323041 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-trusted-ca\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.323135 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.323080 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-ca-trust-extracted\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.323231 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.323134 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj9vb\" (UniqueName: \"kubernetes.io/projected/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-kube-api-access-vj9vb\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.323231 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.323166 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-archives-path\") pod \"periodic-gathering-6r7wl-wbxms\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:26.323231 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.323223 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-registry-tls\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.323407 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.323266 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ef4d3c62-59b9-4127-ba60-06594bcf3c1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-kl7hg\" (UID: \"ef4d3c62-59b9-4127-ba60-06594bcf3c1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7hg" Oct 30 21:53:26.323407 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.323293 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-installation-pull-secrets\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.323407 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.323358 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-trusted-ca-bundle\") pod \"periodic-gathering-6r7wl-wbxms\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:26.323407 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.323389 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-service-ca-bundle\") pod \"periodic-gathering-6r7wl-wbxms\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:26.323607 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.323490 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-archives-path\") pod \"periodic-gathering-6r7wl-wbxms\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:26.324082 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.324063 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-trusted-ca-bundle\") pod \"periodic-gathering-6r7wl-wbxms\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:26.325676 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.325660 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ef4d3c62-59b9-4127-ba60-06594bcf3c1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-kl7hg\" (UID: \"ef4d3c62-59b9-4127-ba60-06594bcf3c1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7hg" Oct 30 21:53:26.335551 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.335532 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg6pw\" (UniqueName: \"kubernetes.io/projected/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-kube-api-access-gg6pw\") pod \"periodic-gathering-6r7wl-wbxms\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:26.424080 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.424032 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-image-registry-private-configuration\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.424080 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.424059 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-registry-certificates\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.424080 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.424078 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-trusted-ca\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.424286 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.424099 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-ca-trust-extracted\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.424286 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.424116 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj9vb\" (UniqueName: \"kubernetes.io/projected/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-kube-api-access-vj9vb\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.424286 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.424145 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-registry-tls\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.424286 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.424178 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-installation-pull-secrets\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.424286 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.424230 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d61a3c1-7782-49be-9760-ec2025db2f82-tmp\") pod \"downloads-6dd789c8b7-f2tqb\" (UID: \"5d61a3c1-7782-49be-9760-ec2025db2f82\") " pod="openshift-console/downloads-6dd789c8b7-f2tqb" Oct 30 21:53:26.424286 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.424259 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdtrj\" (UniqueName: \"kubernetes.io/projected/5d61a3c1-7782-49be-9760-ec2025db2f82-kube-api-access-jdtrj\") pod \"downloads-6dd789c8b7-f2tqb\" (UID: \"5d61a3c1-7782-49be-9760-ec2025db2f82\") " pod="openshift-console/downloads-6dd789c8b7-f2tqb" Oct 30 21:53:26.424286 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.424283 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-bound-sa-token\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.424620 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.424549 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-ca-trust-extracted\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.424796 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.424764 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d61a3c1-7782-49be-9760-ec2025db2f82-tmp\") pod \"downloads-6dd789c8b7-f2tqb\" (UID: \"5d61a3c1-7782-49be-9760-ec2025db2f82\") " pod="openshift-console/downloads-6dd789c8b7-f2tqb" Oct 30 21:53:26.425048 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.425025 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-registry-certificates\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.425279 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.425261 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-trusted-ca\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.426508 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.426486 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-image-registry-private-configuration\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.426615 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.426594 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-installation-pull-secrets\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.426853 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.426838 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-registry-tls\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.431947 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.431928 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:26.445653 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.445634 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdtrj\" (UniqueName: \"kubernetes.io/projected/5d61a3c1-7782-49be-9760-ec2025db2f82-kube-api-access-jdtrj\") pod \"downloads-6dd789c8b7-f2tqb\" (UID: \"5d61a3c1-7782-49be-9760-ec2025db2f82\") " pod="openshift-console/downloads-6dd789c8b7-f2tqb" Oct 30 21:53:26.445779 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.445759 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-bound-sa-token\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.449499 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.449475 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj9vb\" (UniqueName: \"kubernetes.io/projected/cdecbe83-a78d-45d2-bca9-89c4bb2857d5-kube-api-access-vj9vb\") pod \"image-registry-9976cb5f8-znt8v\" (UID: \"cdecbe83-a78d-45d2-bca9-89c4bb2857d5\") " pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.451320 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.451298 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7hg" Oct 30 21:53:26.487052 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.486912 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:26.547927 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.547902 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-f2tqb" Oct 30 21:53:26.553128 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.553110 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:26.695805 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.695722 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:26.710977 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.710949 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-6r7wl-wbxms"] Oct 30 21:53:26.714254 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:26.714230 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9a19ca_d75a_46c1_bd7c_9b5e1c362d0b.slice/crio-7bd7bf41883a8d968e81e6383688af0347d105a44d4dc12d21cb2f82f38b0879 WatchSource:0}: Error finding container 7bd7bf41883a8d968e81e6383688af0347d105a44d4dc12d21cb2f82f38b0879: Status 404 returned error can't find the container with id 7bd7bf41883a8d968e81e6383688af0347d105a44d4dc12d21cb2f82f38b0879 Oct 30 21:53:26.740925 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.740903 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7hg"] Oct 30 21:53:26.742994 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:26.742972 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef4d3c62_59b9_4127_ba60_06594bcf3c1d.slice/crio-0599bf93dcb42515a73f29057548cb5f19e6ae5a32f052855ee7aa22a4ab0fac WatchSource:0}: Error finding container 0599bf93dcb42515a73f29057548cb5f19e6ae5a32f052855ee7aa22a4ab0fac: Status 404 returned error can't find the container with id 0599bf93dcb42515a73f29057548cb5f19e6ae5a32f052855ee7aa22a4ab0fac Oct 30 21:53:26.795233 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.795206 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7hg" event={"ID":"ef4d3c62-59b9-4127-ba60-06594bcf3c1d","Type":"ContainerStarted","Data":"0599bf93dcb42515a73f29057548cb5f19e6ae5a32f052855ee7aa22a4ab0fac"} Oct 30 21:53:26.796584 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.796547 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-6r7wl-wbxms" event={"ID":"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b","Type":"ContainerStarted","Data":"8c40c8ba685ca4e50989f1f22e626a6fec97aa58075f0783f04003b286f22fd5"} Oct 30 21:53:26.796690 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.796596 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-6r7wl-wbxms" event={"ID":"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b","Type":"ContainerStarted","Data":"7bd7bf41883a8d968e81e6383688af0347d105a44d4dc12d21cb2f82f38b0879"} Oct 30 21:53:26.815766 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.815712 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-6r7wl-wbxms" podStartSLOduration=0.815696199 podStartE2EDuration="815.696199ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:26.815377526 +0000 UTC m=+16.338418283" watchObservedRunningTime="2026-10-30 21:53:26.815696199 +0000 UTC m=+16.338736933" Oct 30 21:53:26.819251 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.819224 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:26.822925 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.822901 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-f2tqb"] Oct 30 21:53:26.826992 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:26.826971 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d61a3c1_7782_49be_9760_ec2025db2f82.slice/crio-b0e2a11b0ede19bb7a0e5d3e3fe48f467e59f8d434081ba5285083e0b8c263bd WatchSource:0}: Error finding container b0e2a11b0ede19bb7a0e5d3e3fe48f467e59f8d434081ba5285083e0b8c263bd: Status 404 returned error can't find the container with id b0e2a11b0ede19bb7a0e5d3e3fe48f467e59f8d434081ba5285083e0b8c263bd Oct 30 21:53:26.834785 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.834766 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9976cb5f8-znt8v"] Oct 30 21:53:26.836967 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:26.836944 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdecbe83_a78d_45d2_bca9_89c4bb2857d5.slice/crio-c8631f5ca46e4908c5f9007b28514406da075bda4db33525c02efe4ea9c56a80 WatchSource:0}: Error finding container c8631f5ca46e4908c5f9007b28514406da075bda4db33525c02efe4ea9c56a80: Status 404 returned error can't find the container with id c8631f5ca46e4908c5f9007b28514406da075bda4db33525c02efe4ea9c56a80 Oct 30 21:53:26.960076 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:26.960041 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:27.740375 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:27.740342 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sq7zn" Oct 30 21:53:27.805662 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:27.805629 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-f2tqb" event={"ID":"5d61a3c1-7782-49be-9760-ec2025db2f82","Type":"ContainerStarted","Data":"b0e2a11b0ede19bb7a0e5d3e3fe48f467e59f8d434081ba5285083e0b8c263bd"} Oct 30 21:53:27.810653 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:27.810623 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" event={"ID":"cdecbe83-a78d-45d2-bca9-89c4bb2857d5","Type":"ContainerStarted","Data":"639991a6187e7a53cb9280717a959e2393853b64101331c2b57fe605f118c031"} Oct 30 21:53:27.810761 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:27.810664 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" event={"ID":"cdecbe83-a78d-45d2-bca9-89c4bb2857d5","Type":"ContainerStarted","Data":"c8631f5ca46e4908c5f9007b28514406da075bda4db33525c02efe4ea9c56a80"} Oct 30 21:53:27.810761 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:27.810707 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:27.836235 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:27.836179 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" podStartSLOduration=1.836166594 podStartE2EDuration="1.836166594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:27.834868506 +0000 UTC m=+17.357909231" watchObservedRunningTime="2026-10-30 21:53:27.836166594 +0000 UTC m=+17.359207330" Oct 30 21:53:27.883248 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:27.880621 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:27.980668 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:27.980644 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:28.677026 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:28.676992 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sq7zn_3d901cac-9d8d-48f8-b1a6-61ae43d46721/dns/0.log" Oct 30 21:53:28.816880 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:28.816824 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7hg" event={"ID":"ef4d3c62-59b9-4127-ba60-06594bcf3c1d","Type":"ContainerStarted","Data":"1f098ce2c3bb8ddd0e39204a727df0659dc222ce7621d6a4f4006327d3d76c38"} Oct 30 21:53:28.817323 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:28.817157 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7hg" Oct 30 21:53:28.822383 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:28.822364 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7hg" Oct 30 21:53:28.837071 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:28.837030 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7hg" podStartSLOduration=1.667102995 podStartE2EDuration="2.837018075s" totalImagesPullingTime="1.16991508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:28.836029377 +0000 UTC m=+18.359070111" watchObservedRunningTime="2026-10-30 21:53:28.837018075 +0000 UTC m=+18.360058812" Oct 30 21:53:28.876814 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:28.876756 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sq7zn_3d901cac-9d8d-48f8-b1a6-61ae43d46721/kube-rbac-proxy/0.log" Oct 30 21:53:29.075839 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.075809 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4d225_4d4e36e4-7ca2-4e4f-837d-ebdef77734b1/dns-node-resolver/0.log" Oct 30 21:53:29.477991 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.477963 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6585488f54-nw2ht_012b8527-ec34-4639-b76c-5f941b31d02d/registry/0.log" Oct 30 21:53:29.500916 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.500895 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d75zh" Oct 30 21:53:29.677189 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.677154 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7b99f4cc75-7drms_9ca45dcf-d2cd-4797-be23-47d5ac33b57b/registry/0.log" Oct 30 21:53:29.886214 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.886143 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8"] Oct 30 21:53:29.889460 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.889314 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:29.890791 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.890771 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" Oct 30 21:53:29.895967 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.895687 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Oct 30 21:53:29.898739 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.897556 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mnt5j\"" Oct 30 21:53:29.898739 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.897594 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Oct 30 21:53:29.898739 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.897699 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 21:53:29.918353 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.918331 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8"] Oct 30 21:53:29.918649 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.918599 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-9976cb5f8-znt8v_cdecbe83-a78d-45d2-bca9-89c4bb2857d5/registry/0.log" Oct 30 21:53:29.956140 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.956109 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/414c4be8-0ec0-4901-82da-015aa16e5350-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-jrzf8\" (UID: \"414c4be8-0ec0-4901-82da-015aa16e5350\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" Oct 30 21:53:29.956453 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.956434 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/414c4be8-0ec0-4901-82da-015aa16e5350-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-jrzf8\" (UID: \"414c4be8-0ec0-4901-82da-015aa16e5350\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" Oct 30 21:53:29.956563 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.956477 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw7d9\" (UniqueName: \"kubernetes.io/projected/414c4be8-0ec0-4901-82da-015aa16e5350-kube-api-access-dw7d9\") pod \"prometheus-operator-9cd89b74c-jrzf8\" (UID: \"414c4be8-0ec0-4901-82da-015aa16e5350\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" Oct 30 21:53:29.956563 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:29.956524 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/414c4be8-0ec0-4901-82da-015aa16e5350-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-jrzf8\" (UID: \"414c4be8-0ec0-4901-82da-015aa16e5350\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" Oct 30 21:53:30.022379 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.022337 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:30.057573 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.057541 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/414c4be8-0ec0-4901-82da-015aa16e5350-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-jrzf8\" (UID: \"414c4be8-0ec0-4901-82da-015aa16e5350\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" Oct 30 21:53:30.057706 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.057587 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/414c4be8-0ec0-4901-82da-015aa16e5350-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-jrzf8\" (UID: \"414c4be8-0ec0-4901-82da-015aa16e5350\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" Oct 30 21:53:30.057706 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.057641 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/414c4be8-0ec0-4901-82da-015aa16e5350-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-jrzf8\" (UID: \"414c4be8-0ec0-4901-82da-015aa16e5350\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" Oct 30 21:53:30.057706 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.057669 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw7d9\" (UniqueName: \"kubernetes.io/projected/414c4be8-0ec0-4901-82da-015aa16e5350-kube-api-access-dw7d9\") pod \"prometheus-operator-9cd89b74c-jrzf8\" (UID: \"414c4be8-0ec0-4901-82da-015aa16e5350\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" Oct 30 21:53:30.058415 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.058391 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/414c4be8-0ec0-4901-82da-015aa16e5350-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-jrzf8\" (UID: \"414c4be8-0ec0-4901-82da-015aa16e5350\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" Oct 30 21:53:30.060611 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.060583 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/414c4be8-0ec0-4901-82da-015aa16e5350-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-jrzf8\" (UID: \"414c4be8-0ec0-4901-82da-015aa16e5350\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" Oct 30 21:53:30.060772 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.060692 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/414c4be8-0ec0-4901-82da-015aa16e5350-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-jrzf8\" (UID: \"414c4be8-0ec0-4901-82da-015aa16e5350\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" Oct 30 21:53:30.071416 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.071389 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw7d9\" (UniqueName: \"kubernetes.io/projected/414c4be8-0ec0-4901-82da-015aa16e5350-kube-api-access-dw7d9\") pod \"prometheus-operator-9cd89b74c-jrzf8\" (UID: \"414c4be8-0ec0-4901-82da-015aa16e5350\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" Oct 30 21:53:30.121194 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.121159 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:30.230844 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.230501 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" Oct 30 21:53:30.276071 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.276043 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dgfl4_dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a/node-ca/0.log" Oct 30 21:53:30.477182 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.477091 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c8767fbdc-sxmpb_cc3ee40a-be4e-476f-91ff-a0cd164812fc/router/0.log" Oct 30 21:53:30.512759 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.512685 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8"] Oct 30 21:53:30.516765 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:30.516739 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414c4be8_0ec0_4901_82da_015aa16e5350.slice/crio-3853d464c0574b7aecc499bffe4a01834cada789a94f2bb5c20dee04f086d557 WatchSource:0}: Error finding container 3853d464c0574b7aecc499bffe4a01834cada789a94f2bb5c20dee04f086d557: Status 404 returned error can't find the container with id 3853d464c0574b7aecc499bffe4a01834cada789a94f2bb5c20dee04f086d557 Oct 30 21:53:30.676471 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.676442 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sgzrz_181f4022-4f53-4e23-8424-01f6b5e06ec6/serve-healthcheck-canary/0.log" Oct 30 21:53:30.827908 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:30.827809 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" event={"ID":"414c4be8-0ec0-4901-82da-015aa16e5350","Type":"ContainerStarted","Data":"3853d464c0574b7aecc499bffe4a01834cada789a94f2bb5c20dee04f086d557"} Oct 30 21:53:31.013764 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:31.013720 5052 patch_prober.go:29] interesting pod/image-registry-7b99f4cc75-7drms container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Oct 30 21:53:31.014188 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:31.013782 5052 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" podUID="9ca45dcf-d2cd-4797-be23-47d5ac33b57b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 21:53:32.003731 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:32.003696 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:32.149092 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:32.149008 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:32.263564 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:32.263525 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:32.381350 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:32.381304 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:32.495622 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:32.495590 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:32.639685 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:32.639651 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:32.767059 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:32.766978 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:32.838717 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:32.838682 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" event={"ID":"414c4be8-0ec0-4901-82da-015aa16e5350","Type":"ContainerStarted","Data":"fc5a768330661ba0cdee49c642fb7750c17bd829f438d90445d6751dbe2282ce"} Oct 30 21:53:32.838926 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:32.838747 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" event={"ID":"414c4be8-0ec0-4901-82da-015aa16e5350","Type":"ContainerStarted","Data":"7a90c83cc92d43715c76941f65cf2ce2cbb924692dd6863cd61bd59989d935ec"} Oct 30 21:53:32.859774 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:32.859715 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-jrzf8" podStartSLOduration=2.562865328 podStartE2EDuration="3.859699855s" totalImagesPullingTime="1.296834527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:32.8582614 +0000 UTC m=+22.381302158" watchObservedRunningTime="2026-10-30 21:53:32.859699855 +0000 UTC m=+22.382740589" Oct 30 21:53:33.602423 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:33.602392 5052 scope.go:122] "RemoveContainer" containerID="26904d698d9a0ae8201dcfeade33344aef121db8acfc79c4ad2878d18978cadc" Oct 30 21:53:33.700444 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:33.700418 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:53:33.846411 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:33.846370 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-frqg6" event={"ID":"3cfcee7d-4a08-441e-874b-5486b381d0f2","Type":"ContainerStarted","Data":"de1621dfa6338f206fc8c8d6b8839f62c099349b7778053591bd4dbaf6dba120"} Oct 30 21:53:33.905563 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:33.905479 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:34.017634 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:34.017581 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:35.006474 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:35.004479 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 21:53:35.084870 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.084820 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:35.206110 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.206076 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:35.332665 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.332574 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:35.365708 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.363739 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h6b55"] Oct 30 21:53:35.386184 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.386155 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.405105 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.405063 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 21:53:35.405326 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.405281 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lfmrm\"" Oct 30 21:53:35.405403 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.405383 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 21:53:35.453322 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.453286 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:35.458918 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.458889 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 21:53:35.507451 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.507413 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/567c7e26-46be-4b2e-8db7-3499cc5229f0-node-exporter-textfile\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.507606 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.507550 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/567c7e26-46be-4b2e-8db7-3499cc5229f0-metrics-client-ca\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.507606 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.507593 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/567c7e26-46be-4b2e-8db7-3499cc5229f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.507695 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.507627 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/567c7e26-46be-4b2e-8db7-3499cc5229f0-node-exporter-tls\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.507695 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.507660 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/567c7e26-46be-4b2e-8db7-3499cc5229f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.507784 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.507741 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/567c7e26-46be-4b2e-8db7-3499cc5229f0-sys\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.507889 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.507841 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/567c7e26-46be-4b2e-8db7-3499cc5229f0-node-exporter-wtmp\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.508022 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.507999 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/567c7e26-46be-4b2e-8db7-3499cc5229f0-root\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.508148 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.508058 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtrvx\" (UniqueName: \"kubernetes.io/projected/567c7e26-46be-4b2e-8db7-3499cc5229f0-kube-api-access-vtrvx\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.609237 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.609165 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/567c7e26-46be-4b2e-8db7-3499cc5229f0-sys\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.609237 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.609208 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/567c7e26-46be-4b2e-8db7-3499cc5229f0-node-exporter-wtmp\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.609492 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.609244 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/567c7e26-46be-4b2e-8db7-3499cc5229f0-root\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.609492 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.609266 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtrvx\" (UniqueName: \"kubernetes.io/projected/567c7e26-46be-4b2e-8db7-3499cc5229f0-kube-api-access-vtrvx\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.609492 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.609309 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/567c7e26-46be-4b2e-8db7-3499cc5229f0-node-exporter-textfile\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.609492 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.609368 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/567c7e26-46be-4b2e-8db7-3499cc5229f0-metrics-client-ca\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.609492 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.609392 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/567c7e26-46be-4b2e-8db7-3499cc5229f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.609492 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.609421 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/567c7e26-46be-4b2e-8db7-3499cc5229f0-node-exporter-tls\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.609492 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.609451 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/567c7e26-46be-4b2e-8db7-3499cc5229f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.610099 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.610076 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/567c7e26-46be-4b2e-8db7-3499cc5229f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.610203 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.610157 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/567c7e26-46be-4b2e-8db7-3499cc5229f0-sys\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.610290 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.610275 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/567c7e26-46be-4b2e-8db7-3499cc5229f0-node-exporter-wtmp\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.610351 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.610323 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/567c7e26-46be-4b2e-8db7-3499cc5229f0-root\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.610894 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.610867 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/567c7e26-46be-4b2e-8db7-3499cc5229f0-node-exporter-textfile\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.611286 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.611263 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/567c7e26-46be-4b2e-8db7-3499cc5229f0-metrics-client-ca\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.613352 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.613329 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/567c7e26-46be-4b2e-8db7-3499cc5229f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.613447 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.613330 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/567c7e26-46be-4b2e-8db7-3499cc5229f0-node-exporter-tls\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.624774 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.624750 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtrvx\" (UniqueName: \"kubernetes.io/projected/567c7e26-46be-4b2e-8db7-3499cc5229f0-kube-api-access-vtrvx\") pod \"node-exporter-h6b55\" (UID: \"567c7e26-46be-4b2e-8db7-3499cc5229f0\") " pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.656516 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.656485 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:35.693155 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.693123 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dxkrb" Oct 30 21:53:35.737113 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.737080 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h6b55" Oct 30 21:53:35.761457 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.761367 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:35.782516 ip-10-0-140-139 kubenswrapper[5052]: W1030 21:53:35.782484 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod567c7e26_46be_4b2e_8db7_3499cc5229f0.slice/crio-9a52e0cd1f8c405cf7e1c4a1572206f72cbb3f979a7660052f0f35a05c7b22c9 WatchSource:0}: Error finding container 9a52e0cd1f8c405cf7e1c4a1572206f72cbb3f979a7660052f0f35a05c7b22c9: Status 404 returned error can't find the container with id 9a52e0cd1f8c405cf7e1c4a1572206f72cbb3f979a7660052f0f35a05c7b22c9 Oct 30 21:53:35.856530 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.856495 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6b55" event={"ID":"567c7e26-46be-4b2e-8db7-3499cc5229f0","Type":"ContainerStarted","Data":"9a52e0cd1f8c405cf7e1c4a1572206f72cbb3f979a7660052f0f35a05c7b22c9"} Oct 30 21:53:35.909873 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:35.909781 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:36.162275 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:36.162207 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:36.298057 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:36.298016 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:36.407547 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:36.407512 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:36.620078 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:36.620039 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:36.969528 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:36.969451 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:37.074683 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:37.074646 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:37.868649 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:37.868619 5052 generic.go:356] "Generic (PLEG): container finished" podID="567c7e26-46be-4b2e-8db7-3499cc5229f0" containerID="8ca5fb5fc21329411163cd44176036b01c37cac761668f815ad6cc328890b1d8" exitCode=0 Oct 30 21:53:37.869133 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:37.868697 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6b55" event={"ID":"567c7e26-46be-4b2e-8db7-3499cc5229f0","Type":"ContainerDied","Data":"8ca5fb5fc21329411163cd44176036b01c37cac761668f815ad6cc328890b1d8"} Oct 30 21:53:38.048815 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:38.048786 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:38.168013 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:38.167927 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:38.316175 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:38.316142 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:38.459588 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:38.459497 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:38.580070 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:38.580038 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:38.875508 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:38.875473 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6b55" event={"ID":"567c7e26-46be-4b2e-8db7-3499cc5229f0","Type":"ContainerStarted","Data":"471c21bf73b7edf02e30295b9406fa3adb5358e35ec20da42c5d532ed5394014"} Oct 30 21:53:38.875993 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:38.875524 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6b55" event={"ID":"567c7e26-46be-4b2e-8db7-3499cc5229f0","Type":"ContainerStarted","Data":"8780c00138bebf64e0e62c7b7cea840eb3744186fc4a53372c08c2d41261bb16"} Oct 30 21:53:38.898789 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:38.898744 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h6b55" podStartSLOduration=2.164233894 podStartE2EDuration="3.898731513s" totalImagesPullingTime="1.649108794s" totalInitContainerRuntime="85.388825ms" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:38.897660698 +0000 UTC m=+28.420701433" watchObservedRunningTime="2026-10-30 21:53:38.898731513 +0000 UTC m=+28.421772246" Oct 30 21:53:40.097811 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:40.097757 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:40.296699 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:40.296663 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:40.400020 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:40.399936 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:41.751133 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:41.751085 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:41.866684 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:41.866649 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:42.064486 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:42.064400 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:42.297674 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:42.297622 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:42.407365 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:42.407284 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:43.543617 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:43.543575 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:43.739490 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:43.739457 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:43.904065 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:43.903977 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-f2tqb" event={"ID":"5d61a3c1-7782-49be-9760-ec2025db2f82","Type":"ContainerStarted","Data":"2f201fb3817dbab1571e435ef85a96d75250034a4c8fb2940f4fcd47ffa3c140"} Oct 30 21:53:43.904235 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:43.904175 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-f2tqb" Oct 30 21:53:43.906568 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:43.905488 5052 patch_prober.go:29] interesting pod/downloads-6dd789c8b7-f2tqb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.30:8080/\": dial tcp 10.132.0.30:8080: connect: connection refused" start-of-body= Oct 30 21:53:43.906568 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:43.905534 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6dd789c8b7-f2tqb" podUID="5d61a3c1-7782-49be-9760-ec2025db2f82" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.30:8080/\": dial tcp 10.132.0.30:8080: connect: connection refused" Oct 30 21:53:43.926763 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:43.926719 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-f2tqb" podStartSLOduration=1.066366194 podStartE2EDuration="17.926705594s" totalImagesPullingTime="16.8603394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:43.924241055 +0000 UTC m=+33.447281790" watchObservedRunningTime="2026-10-30 21:53:43.926705594 +0000 UTC m=+33.449746367" Oct 30 21:53:44.275676 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:44.275638 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:44.387292 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:44.387246 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:44.493493 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:44.493460 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:44.921055 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:44.921024 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-f2tqb" Oct 30 21:53:47.168507 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:47.168460 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:47.287386 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:47.287352 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:48.873640 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:48.873607 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:48.974580 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:48.974547 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:49.182079 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:49.181994 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:49.292472 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:49.292418 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:49.398333 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:49.398296 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:49.826952 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:49.826919 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9976cb5f8-znt8v" Oct 30 21:53:49.885701 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:49.885666 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b99f4cc75-7drms"] Oct 30 21:53:49.997662 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:49.997541 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:50.097459 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:50.097360 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:50.203401 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:50.203361 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:50.543434 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:50.543396 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:50.645376 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:50.645338 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:51.178020 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.177981 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6585488f54-nw2ht" podUID="012b8527-ec34-4639-b76c-5f941b31d02d" containerName="registry" containerID="cri-o://5fd2b832df17fafe4c6cbf59b9e3282c28ce73033cde3f16e928b4c4c24f5eaf" gracePeriod=30 Oct 30 21:53:51.463884 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.463837 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:51.565591 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.565544 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-kube-api-access-k6pqj\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-kube-api-access-k6pqj\") pod \"012b8527-ec34-4639-b76c-5f941b31d02d\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " Oct 30 21:53:51.565759 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.565614 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-registry-certificates\") pod \"012b8527-ec34-4639-b76c-5f941b31d02d\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " Oct 30 21:53:51.565759 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.565654 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-installation-pull-secrets\") pod \"012b8527-ec34-4639-b76c-5f941b31d02d\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " Oct 30 21:53:51.565759 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.565697 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-trusted-ca\") pod \"012b8527-ec34-4639-b76c-5f941b31d02d\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " Oct 30 21:53:51.566115 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.566071 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-registry-certificates" pod "012b8527-ec34-4639-b76c-5f941b31d02d" (UID: "012b8527-ec34-4639-b76c-5f941b31d02d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:53:51.566235 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.566156 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-trusted-ca" pod "012b8527-ec34-4639-b76c-5f941b31d02d" (UID: "012b8527-ec34-4639-b76c-5f941b31d02d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:53:51.566235 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.566200 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-bound-sa-token\") pod \"012b8527-ec34-4639-b76c-5f941b31d02d\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " Oct 30 21:53:51.566334 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.566271 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls\") pod \"012b8527-ec34-4639-b76c-5f941b31d02d\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " Oct 30 21:53:51.566334 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.566310 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-image-registry-private-configuration\") pod \"012b8527-ec34-4639-b76c-5f941b31d02d\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " Oct 30 21:53:51.566421 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.566344 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/012b8527-ec34-4639-b76c-5f941b31d02d-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/012b8527-ec34-4639-b76c-5f941b31d02d-ca-trust-extracted\") pod \"012b8527-ec34-4639-b76c-5f941b31d02d\" (UID: \"012b8527-ec34-4639-b76c-5f941b31d02d\") " Oct 30 21:53:51.566622 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.566599 5052 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-registry-certificates\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:51.566784 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.566624 5052 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/012b8527-ec34-4639-b76c-5f941b31d02d-trusted-ca\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:51.568989 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.568963 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls" pod "012b8527-ec34-4639-b76c-5f941b31d02d" (UID: "012b8527-ec34-4639-b76c-5f941b31d02d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:53:51.578443 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.578412 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-image-registry-private-configuration" pod "012b8527-ec34-4639-b76c-5f941b31d02d" (UID: "012b8527-ec34-4639-b76c-5f941b31d02d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:53:51.578901 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.578638 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-installation-pull-secrets" pod "012b8527-ec34-4639-b76c-5f941b31d02d" (UID: "012b8527-ec34-4639-b76c-5f941b31d02d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:53:51.578901 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.578734 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-bound-sa-token" pod "012b8527-ec34-4639-b76c-5f941b31d02d" (UID: "012b8527-ec34-4639-b76c-5f941b31d02d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:53:51.578901 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.578797 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-kube-api-access-k6pqj" pod "012b8527-ec34-4639-b76c-5f941b31d02d" (UID: "012b8527-ec34-4639-b76c-5f941b31d02d"). InnerVolumeSpecName "kube-api-access-k6pqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:53:51.584729 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.584699 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/012b8527-ec34-4639-b76c-5f941b31d02d-ca-trust-extracted" pod "012b8527-ec34-4639-b76c-5f941b31d02d" (UID: "012b8527-ec34-4639-b76c-5f941b31d02d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 21:53:51.667603 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.667575 5052 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-registry-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:51.667603 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.667602 5052 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-image-registry-private-configuration\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:51.667788 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.667621 5052 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/012b8527-ec34-4639-b76c-5f941b31d02d-ca-trust-extracted\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:51.667788 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.667634 5052 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6pqj\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-kube-api-access-k6pqj\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:51.667788 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.667651 5052 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/012b8527-ec34-4639-b76c-5f941b31d02d-installation-pull-secrets\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:51.667788 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.667664 5052 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/012b8527-ec34-4639-b76c-5f941b31d02d-bound-sa-token\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:51.950681 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.950643 5052 generic.go:356] "Generic (PLEG): container finished" podID="012b8527-ec34-4639-b76c-5f941b31d02d" containerID="5fd2b832df17fafe4c6cbf59b9e3282c28ce73033cde3f16e928b4c4c24f5eaf" exitCode=0 Oct 30 21:53:51.950823 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.950705 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6585488f54-nw2ht" Oct 30 21:53:51.950823 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.950754 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6585488f54-nw2ht" event={"ID":"012b8527-ec34-4639-b76c-5f941b31d02d","Type":"ContainerDied","Data":"5fd2b832df17fafe4c6cbf59b9e3282c28ce73033cde3f16e928b4c4c24f5eaf"} Oct 30 21:53:51.950823 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.950802 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6585488f54-nw2ht" event={"ID":"012b8527-ec34-4639-b76c-5f941b31d02d","Type":"ContainerDied","Data":"ab0813b56a7d7d241c315268db3d3b02d8ffa2ffbfa693bc1f19e671f2703756"} Oct 30 21:53:51.950970 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.950832 5052 scope.go:122] "RemoveContainer" containerID="5fd2b832df17fafe4c6cbf59b9e3282c28ce73033cde3f16e928b4c4c24f5eaf" Oct 30 21:53:51.960884 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.960849 5052 scope.go:122] "RemoveContainer" containerID="5fd2b832df17fafe4c6cbf59b9e3282c28ce73033cde3f16e928b4c4c24f5eaf" Oct 30 21:53:51.961223 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:51.961195 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fd2b832df17fafe4c6cbf59b9e3282c28ce73033cde3f16e928b4c4c24f5eaf\": container with ID starting with 5fd2b832df17fafe4c6cbf59b9e3282c28ce73033cde3f16e928b4c4c24f5eaf not found: ID does not exist" containerID="5fd2b832df17fafe4c6cbf59b9e3282c28ce73033cde3f16e928b4c4c24f5eaf" Oct 30 21:53:51.961346 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.961300 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fd2b832df17fafe4c6cbf59b9e3282c28ce73033cde3f16e928b4c4c24f5eaf"} err="failed to get container status \"5fd2b832df17fafe4c6cbf59b9e3282c28ce73033cde3f16e928b4c4c24f5eaf\": rpc error: code = NotFound desc = could not find container \"5fd2b832df17fafe4c6cbf59b9e3282c28ce73033cde3f16e928b4c4c24f5eaf\": container with ID starting with 5fd2b832df17fafe4c6cbf59b9e3282c28ce73033cde3f16e928b4c4c24f5eaf not found: ID does not exist" Oct 30 21:53:51.981622 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.981593 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6585488f54-nw2ht"] Oct 30 21:53:51.990467 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:51.990436 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6585488f54-nw2ht"] Oct 30 21:53:52.608332 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:52.608269 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="012b8527-ec34-4639-b76c-5f941b31d02d" path="/var/lib/kubelet/pods/012b8527-ec34-4639-b76c-5f941b31d02d/volumes" Oct 30 21:53:54.270507 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:54.270471 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:54.371657 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:54.371622 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:58.568373 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:58.568333 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:58.667602 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:58.667553 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:59.325538 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.325506 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-6r7wl-wbxms"] Oct 30 21:53:59.325740 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.325715 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-6r7wl-wbxms" podUID="6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b" containerName="insights-gathering" containerID="cri-o://8c40c8ba685ca4e50989f1f22e626a6fec97aa58075f0783f04003b286f22fd5" gracePeriod=30 Oct 30 21:53:59.329580 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.329557 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-lzjkn-79bnz"] Oct 30 21:53:59.329747 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.329728 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-lzjkn-79bnz" podUID="f2746830-9846-4bb6-afc2-713e6a5cd2e8" containerName="insights-gathering" containerID="cri-o://3251da8823730b5f857cda7fe38c5a7e87706ef47297387294bd2f2182375f54" gracePeriod=30 Oct 30 21:53:59.646494 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.646465 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:59.647641 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.647599 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:59.684608 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.684577 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:59.834117 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.834083 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:59.835012 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.834991 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-service-ca-bundle\") pod \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " Oct 30 21:53:59.835085 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835040 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-archives-path\") pod \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " Oct 30 21:53:59.835085 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835068 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f2746830-9846-4bb6-afc2-713e6a5cd2e8-kube-api-access-8c7wj\" (UniqueName: \"kubernetes.io/projected/f2746830-9846-4bb6-afc2-713e6a5cd2e8-kube-api-access-8c7wj\") pod \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " Oct 30 21:53:59.835176 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835107 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-trusted-ca-bundle\") pod \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " Oct 30 21:53:59.835176 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835140 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-trusted-ca-bundle\") pod \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " Oct 30 21:53:59.835176 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835168 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-service-ca-bundle\") pod \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " Oct 30 21:53:59.835331 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835186 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2746830-9846-4bb6-afc2-713e6a5cd2e8-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/f2746830-9846-4bb6-afc2-713e6a5cd2e8-archives-path\") pod \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\" (UID: \"f2746830-9846-4bb6-afc2-713e6a5cd2e8\") " Oct 30 21:53:59.835331 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835233 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-kube-api-access-gg6pw\" (UniqueName: \"kubernetes.io/projected/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-kube-api-access-gg6pw\") pod \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\" (UID: \"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b\") " Oct 30 21:53:59.835433 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835354 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-service-ca-bundle" pod "6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b" (UID: "6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:53:59.835433 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835415 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-archives-path" pod "6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b" (UID: "6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 21:53:59.835565 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835544 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-trusted-ca-bundle" pod "6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b" (UID: "6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:53:59.835611 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835590 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-service-ca-bundle" pod "f2746830-9846-4bb6-afc2-713e6a5cd2e8" (UID: "f2746830-9846-4bb6-afc2-713e6a5cd2e8"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:53:59.835676 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835660 5052 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-trusted-ca-bundle\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:59.835713 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835681 5052 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-service-ca-bundle\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:59.835713 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835691 5052 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-archives-path\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:59.835847 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835819 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-trusted-ca-bundle" pod "f2746830-9846-4bb6-afc2-713e6a5cd2e8" (UID: "f2746830-9846-4bb6-afc2-713e6a5cd2e8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:53:59.835919 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.835901 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2746830-9846-4bb6-afc2-713e6a5cd2e8-archives-path" pod "f2746830-9846-4bb6-afc2-713e6a5cd2e8" (UID: "f2746830-9846-4bb6-afc2-713e6a5cd2e8"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 21:53:59.837372 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.837353 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-kube-api-access-gg6pw" pod "6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b" (UID: "6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b"). InnerVolumeSpecName "kube-api-access-gg6pw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:53:59.837449 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.837397 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2746830-9846-4bb6-afc2-713e6a5cd2e8-kube-api-access-8c7wj" pod "f2746830-9846-4bb6-afc2-713e6a5cd2e8" (UID: "f2746830-9846-4bb6-afc2-713e6a5cd2e8"). InnerVolumeSpecName "kube-api-access-8c7wj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:53:59.936598 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.936540 5052 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c7wj\" (UniqueName: \"kubernetes.io/projected/f2746830-9846-4bb6-afc2-713e6a5cd2e8-kube-api-access-8c7wj\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:59.936598 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.936570 5052 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-trusted-ca-bundle\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:59.936598 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.936585 5052 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2746830-9846-4bb6-afc2-713e6a5cd2e8-service-ca-bundle\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:59.936598 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.936595 5052 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/f2746830-9846-4bb6-afc2-713e6a5cd2e8-archives-path\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:59.936796 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.936604 5052 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg6pw\" (UniqueName: \"kubernetes.io/projected/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b-kube-api-access-gg6pw\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:53:59.987357 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.987329 5052 generic.go:356] "Generic (PLEG): container finished" podID="f2746830-9846-4bb6-afc2-713e6a5cd2e8" containerID="3251da8823730b5f857cda7fe38c5a7e87706ef47297387294bd2f2182375f54" exitCode=2 Oct 30 21:53:59.987477 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.987384 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-lzjkn-79bnz" Oct 30 21:53:59.987477 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.987412 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-lzjkn-79bnz" event={"ID":"f2746830-9846-4bb6-afc2-713e6a5cd2e8","Type":"ContainerDied","Data":"3251da8823730b5f857cda7fe38c5a7e87706ef47297387294bd2f2182375f54"} Oct 30 21:53:59.987477 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.987465 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-lzjkn-79bnz" event={"ID":"f2746830-9846-4bb6-afc2-713e6a5cd2e8","Type":"ContainerDied","Data":"0533de5ce33c93f1a7d2aa0f2ab6c42fa530f57d6b8738521c09b572d19803bf"} Oct 30 21:53:59.987632 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.987492 5052 scope.go:122] "RemoveContainer" containerID="3251da8823730b5f857cda7fe38c5a7e87706ef47297387294bd2f2182375f54" Oct 30 21:53:59.988654 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.988563 5052 generic.go:356] "Generic (PLEG): container finished" podID="6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b" containerID="8c40c8ba685ca4e50989f1f22e626a6fec97aa58075f0783f04003b286f22fd5" exitCode=2 Oct 30 21:53:59.988654 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.988591 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-6r7wl-wbxms" event={"ID":"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b","Type":"ContainerDied","Data":"8c40c8ba685ca4e50989f1f22e626a6fec97aa58075f0783f04003b286f22fd5"} Oct 30 21:53:59.988654 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.988607 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-6r7wl-wbxms" Oct 30 21:53:59.988654 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.988627 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-6r7wl-wbxms" event={"ID":"6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b","Type":"ContainerDied","Data":"7bd7bf41883a8d968e81e6383688af0347d105a44d4dc12d21cb2f82f38b0879"} Oct 30 21:53:59.997334 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.997319 5052 scope.go:122] "RemoveContainer" containerID="3251da8823730b5f857cda7fe38c5a7e87706ef47297387294bd2f2182375f54" Oct 30 21:53:59.997587 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:53:59.997562 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3251da8823730b5f857cda7fe38c5a7e87706ef47297387294bd2f2182375f54\": container with ID starting with 3251da8823730b5f857cda7fe38c5a7e87706ef47297387294bd2f2182375f54 not found: ID does not exist" containerID="3251da8823730b5f857cda7fe38c5a7e87706ef47297387294bd2f2182375f54" Oct 30 21:53:59.997671 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.997596 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3251da8823730b5f857cda7fe38c5a7e87706ef47297387294bd2f2182375f54"} err="failed to get container status \"3251da8823730b5f857cda7fe38c5a7e87706ef47297387294bd2f2182375f54\": rpc error: code = NotFound desc = could not find container \"3251da8823730b5f857cda7fe38c5a7e87706ef47297387294bd2f2182375f54\": container with ID starting with 3251da8823730b5f857cda7fe38c5a7e87706ef47297387294bd2f2182375f54 not found: ID does not exist" Oct 30 21:53:59.997671 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:53:59.997624 5052 scope.go:122] "RemoveContainer" containerID="8c40c8ba685ca4e50989f1f22e626a6fec97aa58075f0783f04003b286f22fd5" Oct 30 21:54:00.005331 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:00.005308 5052 scope.go:122] "RemoveContainer" containerID="8c40c8ba685ca4e50989f1f22e626a6fec97aa58075f0783f04003b286f22fd5" Oct 30 21:54:00.005598 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:54:00.005578 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c40c8ba685ca4e50989f1f22e626a6fec97aa58075f0783f04003b286f22fd5\": container with ID starting with 8c40c8ba685ca4e50989f1f22e626a6fec97aa58075f0783f04003b286f22fd5 not found: ID does not exist" containerID="8c40c8ba685ca4e50989f1f22e626a6fec97aa58075f0783f04003b286f22fd5" Oct 30 21:54:00.005669 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:00.005608 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c40c8ba685ca4e50989f1f22e626a6fec97aa58075f0783f04003b286f22fd5"} err="failed to get container status \"8c40c8ba685ca4e50989f1f22e626a6fec97aa58075f0783f04003b286f22fd5\": rpc error: code = NotFound desc = could not find container \"8c40c8ba685ca4e50989f1f22e626a6fec97aa58075f0783f04003b286f22fd5\": container with ID starting with 8c40c8ba685ca4e50989f1f22e626a6fec97aa58075f0783f04003b286f22fd5 not found: ID does not exist" Oct 30 21:54:00.012562 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:00.012536 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-lzjkn-79bnz"] Oct 30 21:54:00.014824 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:00.014804 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-lzjkn-79bnz"] Oct 30 21:54:00.026511 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:00.026491 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-6r7wl-wbxms"] Oct 30 21:54:00.030593 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:00.030572 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-6r7wl-wbxms"] Oct 30 21:54:00.607883 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:00.607802 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b" path="/var/lib/kubelet/pods/6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b/volumes" Oct 30 21:54:00.608199 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:00.608185 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f2746830-9846-4bb6-afc2-713e6a5cd2e8" path="/var/lib/kubelet/pods/f2746830-9846-4bb6-afc2-713e6a5cd2e8/volumes" Oct 30 21:54:02.459099 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:02.459063 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:02.561956 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:02.561917 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:02.824391 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:02.824355 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:03.025688 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:03.025657 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:04.986173 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:54:04.986140 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 21:54:08.399026 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:08.398991 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:08.502578 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:08.502542 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:13.575201 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:13.575162 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:13.690363 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:13.690333 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:14.919408 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:14.919366 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" podUID="9ca45dcf-d2cd-4797-be23-47d5ac33b57b" containerName="registry" containerID="cri-o://2b1888be5694898bc4d3e9b6a8c6ea4dceea618eb5bf8e6ddf749d4c57d078b7" gracePeriod=30 Oct 30 21:54:15.051689 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.051657 5052 generic.go:356] "Generic (PLEG): container finished" podID="9ca45dcf-d2cd-4797-be23-47d5ac33b57b" containerID="2b1888be5694898bc4d3e9b6a8c6ea4dceea618eb5bf8e6ddf749d4c57d078b7" exitCode=0 Oct 30 21:54:15.051797 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.051706 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" event={"ID":"9ca45dcf-d2cd-4797-be23-47d5ac33b57b","Type":"ContainerDied","Data":"2b1888be5694898bc4d3e9b6a8c6ea4dceea618eb5bf8e6ddf749d4c57d078b7"} Oct 30 21:54:15.191505 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.191455 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:54:15.252848 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.252822 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls\") pod \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " Oct 30 21:54:15.252991 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.252874 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-ca-trust-extracted\") pod \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " Oct 30 21:54:15.252991 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.252913 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-image-registry-private-configuration\") pod \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " Oct 30 21:54:15.252991 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.252956 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-certificates\") pod \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " Oct 30 21:54:15.252991 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.252982 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-trusted-ca\") pod \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " Oct 30 21:54:15.253217 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.253184 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-installation-pull-secrets\") pod \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " Oct 30 21:54:15.253293 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.253275 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-bound-sa-token\") pod \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " Oct 30 21:54:15.253353 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.253316 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-kube-api-access-vcwnh\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-kube-api-access-vcwnh\") pod \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\" (UID: \"9ca45dcf-d2cd-4797-be23-47d5ac33b57b\") " Oct 30 21:54:15.253446 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.253417 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-trusted-ca" pod "9ca45dcf-d2cd-4797-be23-47d5ac33b57b" (UID: "9ca45dcf-d2cd-4797-be23-47d5ac33b57b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:54:15.253607 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.253582 5052 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-trusted-ca\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:15.253607 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.253423 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-certificates" pod "9ca45dcf-d2cd-4797-be23-47d5ac33b57b" (UID: "9ca45dcf-d2cd-4797-be23-47d5ac33b57b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:54:15.255428 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.255400 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls" pod "9ca45dcf-d2cd-4797-be23-47d5ac33b57b" (UID: "9ca45dcf-d2cd-4797-be23-47d5ac33b57b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:54:15.255593 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.255573 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-image-registry-private-configuration" pod "9ca45dcf-d2cd-4797-be23-47d5ac33b57b" (UID: "9ca45dcf-d2cd-4797-be23-47d5ac33b57b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:15.255656 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.255626 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-bound-sa-token" pod "9ca45dcf-d2cd-4797-be23-47d5ac33b57b" (UID: "9ca45dcf-d2cd-4797-be23-47d5ac33b57b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:54:15.255958 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.255937 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-installation-pull-secrets" pod "9ca45dcf-d2cd-4797-be23-47d5ac33b57b" (UID: "9ca45dcf-d2cd-4797-be23-47d5ac33b57b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:15.256019 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.255983 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-kube-api-access-vcwnh" pod "9ca45dcf-d2cd-4797-be23-47d5ac33b57b" (UID: "9ca45dcf-d2cd-4797-be23-47d5ac33b57b"). InnerVolumeSpecName "kube-api-access-vcwnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:54:15.261738 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.261712 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-ca-trust-extracted" pod "9ca45dcf-d2cd-4797-be23-47d5ac33b57b" (UID: "9ca45dcf-d2cd-4797-be23-47d5ac33b57b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 21:54:15.354501 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.354478 5052 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:15.354501 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.354501 5052 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-ca-trust-extracted\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:15.354629 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.354512 5052 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-image-registry-private-configuration\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:15.354629 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.354521 5052 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-registry-certificates\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:15.354629 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.354531 5052 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-installation-pull-secrets\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:15.354629 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.354540 5052 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-bound-sa-token\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:15.354629 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:15.354550 5052 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcwnh\" (UniqueName: \"kubernetes.io/projected/9ca45dcf-d2cd-4797-be23-47d5ac33b57b-kube-api-access-vcwnh\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:16.056636 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:16.056611 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" Oct 30 21:54:16.057163 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:16.056645 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b99f4cc75-7drms" event={"ID":"9ca45dcf-d2cd-4797-be23-47d5ac33b57b","Type":"ContainerDied","Data":"5d19e8f6efb1ee41a238aef730f361a06aebd466175a6c726a93ccccc5e4a2df"} Oct 30 21:54:16.057163 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:16.056700 5052 scope.go:122] "RemoveContainer" containerID="2b1888be5694898bc4d3e9b6a8c6ea4dceea618eb5bf8e6ddf749d4c57d078b7" Oct 30 21:54:16.082511 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:16.082486 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b99f4cc75-7drms"] Oct 30 21:54:16.088025 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:16.088004 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b99f4cc75-7drms"] Oct 30 21:54:16.607800 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:16.607766 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ca45dcf-d2cd-4797-be23-47d5ac33b57b" path="/var/lib/kubelet/pods/9ca45dcf-d2cd-4797-be23-47d5ac33b57b/volumes" Oct 30 21:54:21.799471 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:21.799427 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:21.902287 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:21.902252 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:22.029081 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:22.029042 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:22.144894 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:22.144789 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:30.120809 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:30.120774 5052 generic.go:356] "Generic (PLEG): container finished" podID="88107d0e-6b47-4320-8647-2a597f418bf4" containerID="33e08809e472a4f87cb688884520143791e4e4743e252e0fdd4841898dfef3c4" exitCode=0 Oct 30 21:54:30.121310 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:30.120846 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" event={"ID":"88107d0e-6b47-4320-8647-2a597f418bf4","Type":"ContainerDied","Data":"33e08809e472a4f87cb688884520143791e4e4743e252e0fdd4841898dfef3c4"} Oct 30 21:54:30.121310 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:30.121267 5052 scope.go:122] "RemoveContainer" containerID="33e08809e472a4f87cb688884520143791e4e4743e252e0fdd4841898dfef3c4" Oct 30 21:54:31.044390 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:31.044351 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:31.127493 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:31.127456 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl" event={"ID":"88107d0e-6b47-4320-8647-2a597f418bf4","Type":"ContainerStarted","Data":"abf83e4c8b56eb2cb726d215a284345ef9972aa80f6316ef6ab75247941c140d"} Oct 30 21:54:31.161221 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:31.161185 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:31.416020 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:31.415926 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:31.518615 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:31.518584 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:34.985644 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:54:34.985612 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 21:54:48.736347 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:48.736299 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:54:59.704447 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:54:59.704411 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:55:04.986049 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:55:04.986017 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 21:55:05.012376 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:55:05.012321 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:55:05.122172 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:55:05.122134 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:55:17.333175 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:55:17.333133 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:55:17.458088 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:55:17.458058 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:55:18.674924 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:55:18.674886 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:55:18.783069 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:55:18.783036 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:55:19.268337 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:55:19.268297 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:55:19.385319 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:55:19.385289 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:55:29.998576 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:55:29.998540 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:55:30.106503 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:55:30.106473 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:55:34.986194 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:55:34.986151 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 21:55:43.608461 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:55:43.608421 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:55:43.753900 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:55:43.753840 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:55:59.811049 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:55:59.811016 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:56:04.986195 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:56:04.986158 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 21:56:23.508057 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:56:23.508017 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:56:23.659268 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:56:23.659233 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:56:34.985891 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:56:34.985833 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 21:56:38.303135 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:56:38.303100 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:56:59.820545 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:56:59.820440 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:57:04.986899 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:57:04.986846 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 21:57:31.280267 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:57:31.280212 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:57:32.088767 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:57:32.088731 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:57:34.986158 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:57:34.986122 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 21:57:49.627353 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:57:49.627320 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:57:49.734036 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:57:49.733997 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:57:59.184185 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:57:59.184148 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:57:59.292602 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:57:59.292574 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:57:59.958086 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:57:59.958055 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:04.986159 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:58:04.986114 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 21:58:06.257309 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:06.257271 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:06.540336 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:06.540251 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:06.711925 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:06.711883 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:06.817601 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:06.817499 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:06.950318 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:06.950289 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:07.118513 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:07.118429 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:07.242692 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:07.242655 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:07.365471 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:07.365437 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:07.566329 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:07.566295 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:07.766309 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:07.766263 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:07.885997 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:07.885917 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:08.017755 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:08.017727 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:10.623968 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:10.623941 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 21:58:10.625241 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:10.625217 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 21:58:16.074702 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:16.074673 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:16.179913 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:16.179851 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:18.986481 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:18.986451 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:19.092706 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:19.092646 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:58:34.986008 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:58:34.985970 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 21:58:59.972248 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:58:59.972194 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:59:00.105260 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:59:00.105228 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:59:04.989178 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:59:04.989136 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 21:59:34.985607 ip-10-0-140-139 kubenswrapper[5052]: E1030 21:59:34.985566 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 21:59:35.982627 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:59:35.982583 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:59:36.143166 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:59:36.143131 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:59:36.271376 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:59:36.271289 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:59:36.388498 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:59:36.388467 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:59:37.682978 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:59:37.682945 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 21:59:37.809639 ip-10-0-140-139 kubenswrapper[5052]: I1030 21:59:37.809589 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:00:00.078921 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:00:00.078828 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:00:04.985139 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:00:04.985105 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:00:34.986091 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:00:34.986042 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:00:51.995381 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:00:51.995326 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:00:52.167383 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:00:52.167342 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:01:00.184141 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:01:00.184087 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:01:03.022214 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:01:03.022181 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:01:03.352220 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:01:03.352132 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:01:03.523432 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:01:03.523386 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:01:04.986615 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:01:04.986580 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:01:06.527964 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:01:06.527912 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:01:06.649062 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:01:06.649030 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:01:21.513686 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:01:21.513649 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:01:34.986940 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:01:34.986904 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:01:41.334983 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:01:41.334944 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:02:00.129171 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:02:00.129140 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:02:04.985949 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:02:04.985914 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:02:34.986162 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:02:34.986121 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:02:42.660210 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:02:42.660174 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:02:43.830543 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:02:43.830502 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:03:00.195170 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:00.195088 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:03:00.989284 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:00.989241 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:03:01.101040 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:01.101003 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:03:02.082761 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.082728 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:03:02.191184 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.191126 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:03:02.434752 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.434663 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:03:02.630342 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.630309 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:03:02.747529 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.747495 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:03:02.798802 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.798774 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj"] Oct 30 22:03:02.799118 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.799105 5052 cpu_manager.go:414] "containerMap: removing container" podUID="012b8527-ec34-4639-b76c-5f941b31d02d" containerName="registry" Oct 30 22:03:02.799172 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.799119 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="012b8527-ec34-4639-b76c-5f941b31d02d" containerName="registry" Oct 30 22:03:02.799172 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.799134 5052 cpu_manager.go:414] "containerMap: removing container" podUID="9ca45dcf-d2cd-4797-be23-47d5ac33b57b" containerName="registry" Oct 30 22:03:02.799172 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.799140 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ca45dcf-d2cd-4797-be23-47d5ac33b57b" containerName="registry" Oct 30 22:03:02.799172 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.799148 5052 cpu_manager.go:414] "containerMap: removing container" podUID="f2746830-9846-4bb6-afc2-713e6a5cd2e8" containerName="insights-gathering" Oct 30 22:03:02.799172 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.799153 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f2746830-9846-4bb6-afc2-713e6a5cd2e8" containerName="insights-gathering" Oct 30 22:03:02.799172 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.799162 5052 cpu_manager.go:414] "containerMap: removing container" podUID="6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b" containerName="insights-gathering" Oct 30 22:03:02.799172 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.799167 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b" containerName="insights-gathering" Oct 30 22:03:02.799372 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.799227 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="012b8527-ec34-4639-b76c-5f941b31d02d" containerName="registry" Oct 30 22:03:02.799372 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.799234 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ca45dcf-d2cd-4797-be23-47d5ac33b57b" containerName="registry" Oct 30 22:03:02.799372 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.799240 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="f2746830-9846-4bb6-afc2-713e6a5cd2e8" containerName="insights-gathering" Oct 30 22:03:02.799372 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.799246 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b9a19ca-d75a-46c1-bd7c-9b5e1c362d0b" containerName="insights-gathering" Oct 30 22:03:02.801119 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.801100 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:03:02.807585 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.807201 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"success-200-isvc-7f5ed-kube-rbac-proxy-sar-config\"" Oct 30 22:03:02.807585 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.807209 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"openshift-service-ca.crt\"" Oct 30 22:03:02.807585 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.807290 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"kube-root-ca.crt\"" Oct 30 22:03:02.812465 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.812443 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj"] Oct 30 22:03:02.831587 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.831568 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"default-dockercfg-jlnw5\"" Oct 30 22:03:02.831587 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.831593 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"success-200-isvc-7f5ed-predictor-serving-cert\"" Oct 30 22:03:02.871294 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.871263 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:03:02.935189 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.935158 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-proxy-tls\") pod \"success-200-isvc-7f5ed-predictor-84c489698b-9lmfj\" (UID: \"fd356d0c-e68f-4e4b-a5ce-bdd92894c598\") " pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:03:02.935317 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.935204 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pfxj\" (UniqueName: \"kubernetes.io/projected/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-kube-api-access-2pfxj\") pod \"success-200-isvc-7f5ed-predictor-84c489698b-9lmfj\" (UID: \"fd356d0c-e68f-4e4b-a5ce-bdd92894c598\") " pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:03:02.935362 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.935337 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-7f5ed-predictor-84c489698b-9lmfj\" (UID: \"fd356d0c-e68f-4e4b-a5ce-bdd92894c598\") " pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:03:02.976011 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:02.975980 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:03:03.036109 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:03.036047 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-proxy-tls\") pod \"success-200-isvc-7f5ed-predictor-84c489698b-9lmfj\" (UID: \"fd356d0c-e68f-4e4b-a5ce-bdd92894c598\") " pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:03:03.036109 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:03.036085 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pfxj\" (UniqueName: \"kubernetes.io/projected/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-kube-api-access-2pfxj\") pod \"success-200-isvc-7f5ed-predictor-84c489698b-9lmfj\" (UID: \"fd356d0c-e68f-4e4b-a5ce-bdd92894c598\") " pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:03:03.036352 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:03.036171 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-7f5ed-predictor-84c489698b-9lmfj\" (UID: \"fd356d0c-e68f-4e4b-a5ce-bdd92894c598\") " pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:03:03.036829 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:03.036811 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-7f5ed-predictor-84c489698b-9lmfj\" (UID: \"fd356d0c-e68f-4e4b-a5ce-bdd92894c598\") " pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:03:03.038491 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:03.038467 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-proxy-tls\") pod \"success-200-isvc-7f5ed-predictor-84c489698b-9lmfj\" (UID: \"fd356d0c-e68f-4e4b-a5ce-bdd92894c598\") " pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:03:03.047801 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:03.047778 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pfxj\" (UniqueName: \"kubernetes.io/projected/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-kube-api-access-2pfxj\") pod \"success-200-isvc-7f5ed-predictor-84c489698b-9lmfj\" (UID: \"fd356d0c-e68f-4e4b-a5ce-bdd92894c598\") " pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:03:03.096151 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:03.096120 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:03:03.113357 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:03.113326 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:03:03.202994 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:03.202963 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:03:03.386125 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:03.386052 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj"] Oct 30 22:03:03.389438 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:03:03.389408 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd356d0c_e68f_4e4b_a5ce_bdd92894c598.slice/crio-448ae8a0f95eeaf724f798509f004cca3034c3881359f824867db1770415cb5e WatchSource:0}: Error finding container 448ae8a0f95eeaf724f798509f004cca3034c3881359f824867db1770415cb5e: Status 404 returned error can't find the container with id 448ae8a0f95eeaf724f798509f004cca3034c3881359f824867db1770415cb5e Oct 30 22:03:03.391318 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:03.391301 5052 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:03:04.127356 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:04.127321 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" event={"ID":"fd356d0c-e68f-4e4b-a5ce-bdd92894c598","Type":"ContainerStarted","Data":"448ae8a0f95eeaf724f798509f004cca3034c3881359f824867db1770415cb5e"} Oct 30 22:03:04.999532 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:03:04.999490 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:03:10.650391 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:10.650366 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:03:10.652431 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:10.652409 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:03:16.184844 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:16.184764 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" event={"ID":"fd356d0c-e68f-4e4b-a5ce-bdd92894c598","Type":"ContainerStarted","Data":"a9dca334d5456a7cb18947718de920a6f03b32f608e0b986b75ff8783345cc16"} Oct 30 22:03:19.200912 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:19.200874 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" event={"ID":"fd356d0c-e68f-4e4b-a5ce-bdd92894c598","Type":"ContainerStarted","Data":"1d4af4a2d3efd47f844b4f0957da5a138ca0bd5ea4cf3708ca34691a46b3cd54"} Oct 30 22:03:19.201320 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:19.200935 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:03:19.201320 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:19.200960 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:03:19.202272 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:19.202244 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused" Oct 30 22:03:19.222249 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:19.222089 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" podStartSLOduration=2.242812614 podStartE2EDuration="17.222075713s" totalImagesPullingTime="14.979263099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:19.221044077 +0000 UTC m=+608.744084821" watchObservedRunningTime="2026-10-30 22:03:19.222075713 +0000 UTC m=+608.745116438" Oct 30 22:03:20.204984 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:20.204942 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused" Oct 30 22:03:25.209624 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:25.209588 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:03:25.210070 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:25.209966 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused" Oct 30 22:03:27.271629 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:27.271596 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:03:27.383091 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:27.383048 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:03:34.986304 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:03:34.986264 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:03:35.210065 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:35.210024 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused" Oct 30 22:03:45.210827 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:45.210790 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused" Oct 30 22:03:55.210439 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:03:55.210400 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused" Oct 30 22:04:00.243555 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:00.243505 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:04:04.985500 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:04:04.985463 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:04:05.211001 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:05.210971 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:04:22.515495 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:22.515454 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:04:22.622969 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:22.622930 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:04:32.777982 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:32.777951 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf"] Oct 30 22:04:32.781502 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:32.781480 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" Oct 30 22:04:32.790334 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:32.790310 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"switch-graph-7f5ed-serving-cert\"" Oct 30 22:04:32.790440 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:32.790358 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"switch-graph-7f5ed-kube-rbac-proxy-sar-config\"" Oct 30 22:04:32.792760 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:32.792734 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf"] Oct 30 22:04:32.820384 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:32.820346 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:04:32.845848 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:32.845819 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a45babc0-c279-42f0-a0a0-042aaf4b7b0b-openshift-service-ca-bundle\") pod \"switch-graph-7f5ed-78948d76cb-nv8qf\" (UID: \"a45babc0-c279-42f0-a0a0-042aaf4b7b0b\") " pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" Oct 30 22:04:32.845964 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:32.845897 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a45babc0-c279-42f0-a0a0-042aaf4b7b0b-proxy-tls\") pod \"switch-graph-7f5ed-78948d76cb-nv8qf\" (UID: \"a45babc0-c279-42f0-a0a0-042aaf4b7b0b\") " pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" Oct 30 22:04:32.923009 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:32.922974 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:04:32.947086 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:32.947057 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a45babc0-c279-42f0-a0a0-042aaf4b7b0b-proxy-tls\") pod \"switch-graph-7f5ed-78948d76cb-nv8qf\" (UID: \"a45babc0-c279-42f0-a0a0-042aaf4b7b0b\") " pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" Oct 30 22:04:32.947225 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:32.947112 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a45babc0-c279-42f0-a0a0-042aaf4b7b0b-openshift-service-ca-bundle\") pod \"switch-graph-7f5ed-78948d76cb-nv8qf\" (UID: \"a45babc0-c279-42f0-a0a0-042aaf4b7b0b\") " pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" Oct 30 22:04:32.947701 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:32.947679 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a45babc0-c279-42f0-a0a0-042aaf4b7b0b-openshift-service-ca-bundle\") pod \"switch-graph-7f5ed-78948d76cb-nv8qf\" (UID: \"a45babc0-c279-42f0-a0a0-042aaf4b7b0b\") " pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" Oct 30 22:04:32.949439 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:32.949410 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a45babc0-c279-42f0-a0a0-042aaf4b7b0b-proxy-tls\") pod \"switch-graph-7f5ed-78948d76cb-nv8qf\" (UID: \"a45babc0-c279-42f0-a0a0-042aaf4b7b0b\") " pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" Oct 30 22:04:33.095330 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:33.095265 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" Oct 30 22:04:33.365975 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:33.365903 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf"] Oct 30 22:04:33.369296 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:04:33.369266 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda45babc0_c279_42f0_a0a0_042aaf4b7b0b.slice/crio-15dd5b94c733f6e27a7fffc3f79be9c5781aae9ccb3fa1b437e5734875dee472 WatchSource:0}: Error finding container 15dd5b94c733f6e27a7fffc3f79be9c5781aae9ccb3fa1b437e5734875dee472: Status 404 returned error can't find the container with id 15dd5b94c733f6e27a7fffc3f79be9c5781aae9ccb3fa1b437e5734875dee472 Oct 30 22:04:33.500880 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:33.500826 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" event={"ID":"a45babc0-c279-42f0-a0a0-042aaf4b7b0b","Type":"ContainerStarted","Data":"15dd5b94c733f6e27a7fffc3f79be9c5781aae9ccb3fa1b437e5734875dee472"} Oct 30 22:04:34.997219 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:04:34.997160 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:04:40.535161 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:40.535127 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" event={"ID":"a45babc0-c279-42f0-a0a0-042aaf4b7b0b","Type":"ContainerStarted","Data":"8a05e2300cf79ae060729d501094216537a3b5ba264e22c06bc216293d74b6ae"} Oct 30 22:04:40.535574 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:40.535194 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" Oct 30 22:04:40.555142 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:40.555100 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" podStartSLOduration=2.330629024 podStartE2EDuration="8.555086739s" totalImagesPullingTime="6.224457715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:40.554017961 +0000 UTC m=+690.077058727" watchObservedRunningTime="2026-10-30 22:04:40.555086739 +0000 UTC m=+690.078127483" Oct 30 22:04:46.546326 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:46.546299 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" Oct 30 22:04:48.139233 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:48.139198 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj"] Oct 30 22:04:48.139727 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:48.139463 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerName="kserve-container" containerID="cri-o://a9dca334d5456a7cb18947718de920a6f03b32f608e0b986b75ff8783345cc16" gracePeriod=30 Oct 30 22:04:48.139727 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:48.139526 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerName="kube-rbac-proxy" containerID="cri-o://1d4af4a2d3efd47f844b4f0957da5a138ca0bd5ea4cf3708ca34691a46b3cd54" gracePeriod=30 Oct 30 22:04:48.176742 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:48.176713 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:04:48.281221 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:48.281190 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:04:48.572715 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:48.572681 5052 generic.go:356] "Generic (PLEG): container finished" podID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerID="1d4af4a2d3efd47f844b4f0957da5a138ca0bd5ea4cf3708ca34691a46b3cd54" exitCode=0 Oct 30 22:04:48.572898 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:48.572734 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" event={"ID":"fd356d0c-e68f-4e4b-a5ce-bdd92894c598","Type":"ContainerDied","Data":"1d4af4a2d3efd47f844b4f0957da5a138ca0bd5ea4cf3708ca34691a46b3cd54"} Oct 30 22:04:50.206095 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:50.206057 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.33:8643/healthz\": dial tcp 10.132.0.33:8643: connect: connection refused" Oct 30 22:04:51.381938 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.381914 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:04:51.493837 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.493809 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-proxy-tls\" (UniqueName: \"kubernetes.io/secret/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-proxy-tls\") pod \"fd356d0c-e68f-4e4b-a5ce-bdd92894c598\" (UID: \"fd356d0c-e68f-4e4b-a5ce-bdd92894c598\") " Oct 30 22:04:51.494004 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.493904 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-kube-rbac-proxy-sar-config\") pod \"fd356d0c-e68f-4e4b-a5ce-bdd92894c598\" (UID: \"fd356d0c-e68f-4e4b-a5ce-bdd92894c598\") " Oct 30 22:04:51.494074 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.494056 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-kube-api-access-2pfxj\" (UniqueName: \"kubernetes.io/projected/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-kube-api-access-2pfxj\") pod \"fd356d0c-e68f-4e4b-a5ce-bdd92894c598\" (UID: \"fd356d0c-e68f-4e4b-a5ce-bdd92894c598\") " Oct 30 22:04:51.494253 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.494231 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-kube-rbac-proxy-sar-config" pod "fd356d0c-e68f-4e4b-a5ce-bdd92894c598" (UID: "fd356d0c-e68f-4e4b-a5ce-bdd92894c598"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:04:51.496125 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.496094 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-proxy-tls" pod "fd356d0c-e68f-4e4b-a5ce-bdd92894c598" (UID: "fd356d0c-e68f-4e4b-a5ce-bdd92894c598"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:04:51.496125 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.496117 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-kube-api-access-2pfxj" pod "fd356d0c-e68f-4e4b-a5ce-bdd92894c598" (UID: "fd356d0c-e68f-4e4b-a5ce-bdd92894c598"). InnerVolumeSpecName "kube-api-access-2pfxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:04:51.585641 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.585609 5052 generic.go:356] "Generic (PLEG): container finished" podID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerID="a9dca334d5456a7cb18947718de920a6f03b32f608e0b986b75ff8783345cc16" exitCode=0 Oct 30 22:04:51.585797 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.585650 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" event={"ID":"fd356d0c-e68f-4e4b-a5ce-bdd92894c598","Type":"ContainerDied","Data":"a9dca334d5456a7cb18947718de920a6f03b32f608e0b986b75ff8783345cc16"} Oct 30 22:04:51.585797 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.585658 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" Oct 30 22:04:51.585797 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.585698 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj" event={"ID":"fd356d0c-e68f-4e4b-a5ce-bdd92894c598","Type":"ContainerDied","Data":"448ae8a0f95eeaf724f798509f004cca3034c3881359f824867db1770415cb5e"} Oct 30 22:04:51.585797 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.585725 5052 scope.go:122] "RemoveContainer" containerID="1d4af4a2d3efd47f844b4f0957da5a138ca0bd5ea4cf3708ca34691a46b3cd54" Oct 30 22:04:51.594621 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.594592 5052 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-kube-rbac-proxy-sar-config\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:04:51.594621 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.594621 5052 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pfxj\" (UniqueName: \"kubernetes.io/projected/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-kube-api-access-2pfxj\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:04:51.594817 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.594637 5052 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fd356d0c-e68f-4e4b-a5ce-bdd92894c598-proxy-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:04:51.596002 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.595986 5052 scope.go:122] "RemoveContainer" containerID="a9dca334d5456a7cb18947718de920a6f03b32f608e0b986b75ff8783345cc16" Oct 30 22:04:51.603350 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.603331 5052 scope.go:122] "RemoveContainer" containerID="1d4af4a2d3efd47f844b4f0957da5a138ca0bd5ea4cf3708ca34691a46b3cd54" Oct 30 22:04:51.603618 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:04:51.603596 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d4af4a2d3efd47f844b4f0957da5a138ca0bd5ea4cf3708ca34691a46b3cd54\": container with ID starting with 1d4af4a2d3efd47f844b4f0957da5a138ca0bd5ea4cf3708ca34691a46b3cd54 not found: ID does not exist" containerID="1d4af4a2d3efd47f844b4f0957da5a138ca0bd5ea4cf3708ca34691a46b3cd54" Oct 30 22:04:51.603707 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.603624 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d4af4a2d3efd47f844b4f0957da5a138ca0bd5ea4cf3708ca34691a46b3cd54"} err="failed to get container status \"1d4af4a2d3efd47f844b4f0957da5a138ca0bd5ea4cf3708ca34691a46b3cd54\": rpc error: code = NotFound desc = could not find container \"1d4af4a2d3efd47f844b4f0957da5a138ca0bd5ea4cf3708ca34691a46b3cd54\": container with ID starting with 1d4af4a2d3efd47f844b4f0957da5a138ca0bd5ea4cf3708ca34691a46b3cd54 not found: ID does not exist" Oct 30 22:04:51.603707 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.603641 5052 scope.go:122] "RemoveContainer" containerID="a9dca334d5456a7cb18947718de920a6f03b32f608e0b986b75ff8783345cc16" Oct 30 22:04:51.603915 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:04:51.603902 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9dca334d5456a7cb18947718de920a6f03b32f608e0b986b75ff8783345cc16\": container with ID starting with a9dca334d5456a7cb18947718de920a6f03b32f608e0b986b75ff8783345cc16 not found: ID does not exist" containerID="a9dca334d5456a7cb18947718de920a6f03b32f608e0b986b75ff8783345cc16" Oct 30 22:04:51.603958 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.603919 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9dca334d5456a7cb18947718de920a6f03b32f608e0b986b75ff8783345cc16"} err="failed to get container status \"a9dca334d5456a7cb18947718de920a6f03b32f608e0b986b75ff8783345cc16\": rpc error: code = NotFound desc = could not find container \"a9dca334d5456a7cb18947718de920a6f03b32f608e0b986b75ff8783345cc16\": container with ID starting with a9dca334d5456a7cb18947718de920a6f03b32f608e0b986b75ff8783345cc16 not found: ID does not exist" Oct 30 22:04:51.609007 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.608988 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj"] Oct 30 22:04:51.613057 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:51.613038 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-7f5ed-predictor-84c489698b-9lmfj"] Oct 30 22:04:52.606511 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:52.606478 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" path="/var/lib/kubelet/pods/fd356d0c-e68f-4e4b-a5ce-bdd92894c598/volumes" Oct 30 22:04:53.492826 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.492789 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:04:53.525464 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.525436 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75"] Oct 30 22:04:53.525773 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.525761 5052 cpu_manager.go:414] "containerMap: removing container" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerName="kserve-container" Oct 30 22:04:53.525814 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.525774 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerName="kserve-container" Oct 30 22:04:53.525814 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.525785 5052 cpu_manager.go:414] "containerMap: removing container" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerName="kube-rbac-proxy" Oct 30 22:04:53.525814 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.525790 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerName="kube-rbac-proxy" Oct 30 22:04:53.525927 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.525853 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerName="kserve-container" Oct 30 22:04:53.525927 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.525872 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="fd356d0c-e68f-4e4b-a5ce-bdd92894c598" containerName="kube-rbac-proxy" Oct 30 22:04:53.530734 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.530718 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:04:53.541187 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.541164 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"success-200-isvc-3c7da-kube-rbac-proxy-sar-config\"" Oct 30 22:04:53.541291 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.541173 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"success-200-isvc-3c7da-predictor-serving-cert\"" Oct 30 22:04:53.541291 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.541206 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"kube-root-ca.crt\"" Oct 30 22:04:53.542547 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.542528 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75"] Oct 30 22:04:53.604623 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.604596 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:04:53.608661 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.608639 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/29aae98b-345c-4f87-9469-4e1c16941e33-proxy-tls\") pod \"success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75\" (UID: \"29aae98b-345c-4f87-9469-4e1c16941e33\") " pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:04:53.608966 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.608693 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldffw\" (UniqueName: \"kubernetes.io/projected/29aae98b-345c-4f87-9469-4e1c16941e33-kube-api-access-ldffw\") pod \"success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75\" (UID: \"29aae98b-345c-4f87-9469-4e1c16941e33\") " pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:04:53.608966 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.608764 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/29aae98b-345c-4f87-9469-4e1c16941e33-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75\" (UID: \"29aae98b-345c-4f87-9469-4e1c16941e33\") " pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:04:53.709370 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.709341 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/29aae98b-345c-4f87-9469-4e1c16941e33-proxy-tls\") pod \"success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75\" (UID: \"29aae98b-345c-4f87-9469-4e1c16941e33\") " pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:04:53.709512 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.709489 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldffw\" (UniqueName: \"kubernetes.io/projected/29aae98b-345c-4f87-9469-4e1c16941e33-kube-api-access-ldffw\") pod \"success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75\" (UID: \"29aae98b-345c-4f87-9469-4e1c16941e33\") " pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:04:53.709569 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.709536 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/29aae98b-345c-4f87-9469-4e1c16941e33-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75\" (UID: \"29aae98b-345c-4f87-9469-4e1c16941e33\") " pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:04:53.710200 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.710172 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/29aae98b-345c-4f87-9469-4e1c16941e33-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75\" (UID: \"29aae98b-345c-4f87-9469-4e1c16941e33\") " pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:04:53.711675 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.711658 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/29aae98b-345c-4f87-9469-4e1c16941e33-proxy-tls\") pod \"success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75\" (UID: \"29aae98b-345c-4f87-9469-4e1c16941e33\") " pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:04:53.730087 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.730069 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldffw\" (UniqueName: \"kubernetes.io/projected/29aae98b-345c-4f87-9469-4e1c16941e33-kube-api-access-ldffw\") pod \"success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75\" (UID: \"29aae98b-345c-4f87-9469-4e1c16941e33\") " pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:04:53.767475 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.767407 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:04:53.846319 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.846294 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:04:53.877252 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:53.877224 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:04:54.121578 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:54.121492 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75"] Oct 30 22:04:54.125916 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:04:54.125890 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29aae98b_345c_4f87_9469_4e1c16941e33.slice/crio-1e3c4b0f27e0fd283d859a1b0df32856f12c28b7000fd2628c20427eace86b79 WatchSource:0}: Error finding container 1e3c4b0f27e0fd283d859a1b0df32856f12c28b7000fd2628c20427eace86b79: Status 404 returned error can't find the container with id 1e3c4b0f27e0fd283d859a1b0df32856f12c28b7000fd2628c20427eace86b79 Oct 30 22:04:54.600655 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:54.600620 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" event={"ID":"29aae98b-345c-4f87-9469-4e1c16941e33","Type":"ContainerStarted","Data":"57f1a5eaab755d17abf79a6c57bda88a6eca6811b98558031a20ba4959809238"} Oct 30 22:04:54.600822 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:54.600685 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" event={"ID":"29aae98b-345c-4f87-9469-4e1c16941e33","Type":"ContainerStarted","Data":"aacc0b03fe067964883678ef026f0661a17cd4319383df47ca8c8dae09442dce"} Oct 30 22:04:54.600822 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:54.600718 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" event={"ID":"29aae98b-345c-4f87-9469-4e1c16941e33","Type":"ContainerStarted","Data":"1e3c4b0f27e0fd283d859a1b0df32856f12c28b7000fd2628c20427eace86b79"} Oct 30 22:04:54.600822 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:54.600749 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:04:54.632672 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:54.632628 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" podStartSLOduration=1.63261594 podStartE2EDuration="1.63261594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:54.63054663 +0000 UTC m=+704.153587363" watchObservedRunningTime="2026-10-30 22:04:54.63261594 +0000 UTC m=+704.155656667" Oct 30 22:04:55.604502 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:55.604469 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:04:55.605963 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:55.605933 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused" Oct 30 22:04:56.613682 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:04:56.613643 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused" Oct 30 22:05:00.318447 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:00.318407 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:05:01.618542 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:01.618514 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:05:01.619025 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:01.618998 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused" Oct 30 22:05:03.773007 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:03.772973 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:05:04.985822 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:05:04.985786 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:05:11.619851 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:11.619811 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused" Oct 30 22:05:21.619482 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:21.619438 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused" Oct 30 22:05:22.353411 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.353378 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j"] Oct 30 22:05:22.357913 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.357896 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" Oct 30 22:05:22.368355 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.368325 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"model-chainer-kube-rbac-proxy-sar-config\"" Oct 30 22:05:22.368574 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.368558 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"openshift-service-ca.crt\"" Oct 30 22:05:22.368653 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.368580 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"default-dockercfg-kk2z5\"" Oct 30 22:05:22.368653 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.368617 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"model-chainer-serving-cert\"" Oct 30 22:05:22.369123 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.369104 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j"] Oct 30 22:05:22.385696 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.385453 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:05:22.508064 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.508015 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:05:22.534104 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.534082 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f51a0c9e-6e5b-4220-aa8e-d3edd389b738-proxy-tls\") pod \"model-chainer-69f597b54c-8hb4j\" (UID: \"f51a0c9e-6e5b-4220-aa8e-d3edd389b738\") " pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" Oct 30 22:05:22.534246 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.534224 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f51a0c9e-6e5b-4220-aa8e-d3edd389b738-openshift-service-ca-bundle\") pod \"model-chainer-69f597b54c-8hb4j\" (UID: \"f51a0c9e-6e5b-4220-aa8e-d3edd389b738\") " pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" Oct 30 22:05:22.635104 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.635038 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f51a0c9e-6e5b-4220-aa8e-d3edd389b738-openshift-service-ca-bundle\") pod \"model-chainer-69f597b54c-8hb4j\" (UID: \"f51a0c9e-6e5b-4220-aa8e-d3edd389b738\") " pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" Oct 30 22:05:22.635104 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.635093 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f51a0c9e-6e5b-4220-aa8e-d3edd389b738-proxy-tls\") pod \"model-chainer-69f597b54c-8hb4j\" (UID: \"f51a0c9e-6e5b-4220-aa8e-d3edd389b738\") " pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" Oct 30 22:05:22.635642 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.635624 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f51a0c9e-6e5b-4220-aa8e-d3edd389b738-openshift-service-ca-bundle\") pod \"model-chainer-69f597b54c-8hb4j\" (UID: \"f51a0c9e-6e5b-4220-aa8e-d3edd389b738\") " pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" Oct 30 22:05:22.637529 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.637510 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f51a0c9e-6e5b-4220-aa8e-d3edd389b738-proxy-tls\") pod \"model-chainer-69f597b54c-8hb4j\" (UID: \"f51a0c9e-6e5b-4220-aa8e-d3edd389b738\") " pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" Oct 30 22:05:22.670565 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.670542 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" Oct 30 22:05:22.944439 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:22.944364 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j"] Oct 30 22:05:22.947704 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:05:22.947679 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51a0c9e_6e5b_4220_aa8e_d3edd389b738.slice/crio-1674237253f02eb3194918789ae09971be1500baf5149c401c85020d9a579e4b WatchSource:0}: Error finding container 1674237253f02eb3194918789ae09971be1500baf5149c401c85020d9a579e4b: Status 404 returned error can't find the container with id 1674237253f02eb3194918789ae09971be1500baf5149c401c85020d9a579e4b Oct 30 22:05:23.723991 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:23.723962 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" event={"ID":"f51a0c9e-6e5b-4220-aa8e-d3edd389b738","Type":"ContainerStarted","Data":"8721d2b314402a4917a116ceab2e0d104e454fa73b1a47a12747f5181ee9ce74"} Oct 30 22:05:23.724361 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:23.724010 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" event={"ID":"f51a0c9e-6e5b-4220-aa8e-d3edd389b738","Type":"ContainerStarted","Data":"1674237253f02eb3194918789ae09971be1500baf5149c401c85020d9a579e4b"} Oct 30 22:05:23.724361 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:23.724046 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" Oct 30 22:05:23.744402 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:23.744354 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" podStartSLOduration=1.744341044 podStartE2EDuration="1.744341044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:23.743182659 +0000 UTC m=+733.266223410" watchObservedRunningTime="2026-10-30 22:05:23.744341044 +0000 UTC m=+733.267381777" Oct 30 22:05:29.732844 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:29.732814 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" Oct 30 22:05:31.619316 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:31.619277 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused" Oct 30 22:05:34.098708 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:34.098671 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:05:34.203515 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:34.203479 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:05:34.988080 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:05:34.988041 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:05:41.569830 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.569798 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2"] Oct 30 22:05:41.573416 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.573395 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:05:41.574420 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.574398 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:05:41.581825 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.581804 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"success-200-isvc-e9913-predictor-serving-cert\"" Oct 30 22:05:41.587383 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.587361 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"success-200-isvc-e9913-kube-rbac-proxy-sar-config\"" Oct 30 22:05:41.587461 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.587399 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"kube-root-ca.crt\"" Oct 30 22:05:41.592185 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.592165 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2"] Oct 30 22:05:41.619327 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.619293 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused" Oct 30 22:05:41.681801 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.681767 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6trj\" (UniqueName: \"kubernetes.io/projected/ecb560c7-e0d0-4bfb-8844-c407c365cee6-kube-api-access-m6trj\") pod \"success-200-isvc-e9913-predictor-97cc787fd-c8vb2\" (UID: \"ecb560c7-e0d0-4bfb-8844-c407c365cee6\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:05:41.681964 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.681809 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ecb560c7-e0d0-4bfb-8844-c407c365cee6-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-e9913-predictor-97cc787fd-c8vb2\" (UID: \"ecb560c7-e0d0-4bfb-8844-c407c365cee6\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:05:41.681964 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.681836 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ecb560c7-e0d0-4bfb-8844-c407c365cee6-proxy-tls\") pod \"success-200-isvc-e9913-predictor-97cc787fd-c8vb2\" (UID: \"ecb560c7-e0d0-4bfb-8844-c407c365cee6\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:05:41.693369 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.693341 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:05:41.782532 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.782501 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ecb560c7-e0d0-4bfb-8844-c407c365cee6-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-e9913-predictor-97cc787fd-c8vb2\" (UID: \"ecb560c7-e0d0-4bfb-8844-c407c365cee6\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:05:41.782532 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.782537 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ecb560c7-e0d0-4bfb-8844-c407c365cee6-proxy-tls\") pod \"success-200-isvc-e9913-predictor-97cc787fd-c8vb2\" (UID: \"ecb560c7-e0d0-4bfb-8844-c407c365cee6\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:05:41.782759 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.782606 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6trj\" (UniqueName: \"kubernetes.io/projected/ecb560c7-e0d0-4bfb-8844-c407c365cee6-kube-api-access-m6trj\") pod \"success-200-isvc-e9913-predictor-97cc787fd-c8vb2\" (UID: \"ecb560c7-e0d0-4bfb-8844-c407c365cee6\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:05:41.783282 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.783260 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ecb560c7-e0d0-4bfb-8844-c407c365cee6-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-e9913-predictor-97cc787fd-c8vb2\" (UID: \"ecb560c7-e0d0-4bfb-8844-c407c365cee6\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:05:41.784950 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.784928 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ecb560c7-e0d0-4bfb-8844-c407c365cee6-proxy-tls\") pod \"success-200-isvc-e9913-predictor-97cc787fd-c8vb2\" (UID: \"ecb560c7-e0d0-4bfb-8844-c407c365cee6\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:05:41.802755 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.802732 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6trj\" (UniqueName: \"kubernetes.io/projected/ecb560c7-e0d0-4bfb-8844-c407c365cee6-kube-api-access-m6trj\") pod \"success-200-isvc-e9913-predictor-97cc787fd-c8vb2\" (UID: \"ecb560c7-e0d0-4bfb-8844-c407c365cee6\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:05:41.818750 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.818705 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:05:41.887730 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.887655 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:05:41.938426 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:41.938396 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:05:42.168313 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:42.168234 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2"] Oct 30 22:05:42.172291 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:05:42.172262 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb560c7_e0d0_4bfb_8844_c407c365cee6.slice/crio-a9558cb631d7c4730d866835667ef8d08d2451bf2ce2c3449d92edae891af275 WatchSource:0}: Error finding container a9558cb631d7c4730d866835667ef8d08d2451bf2ce2c3449d92edae891af275: Status 404 returned error can't find the container with id a9558cb631d7c4730d866835667ef8d08d2451bf2ce2c3449d92edae891af275 Oct 30 22:05:42.802849 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:42.802813 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" event={"ID":"ecb560c7-e0d0-4bfb-8844-c407c365cee6","Type":"ContainerStarted","Data":"d878130e5e575f0fee1bad7b7e0a7e292981454e907180d9c656c97fee2cc896"} Oct 30 22:05:42.803282 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:42.802897 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" event={"ID":"ecb560c7-e0d0-4bfb-8844-c407c365cee6","Type":"ContainerStarted","Data":"5c54393a175620ce3be1428157e2494f88c5bceb0216a6bbbf4120fffcc7c2ef"} Oct 30 22:05:42.803282 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:42.802931 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:05:42.803282 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:42.802963 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:05:42.803282 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:42.802982 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" event={"ID":"ecb560c7-e0d0-4bfb-8844-c407c365cee6","Type":"ContainerStarted","Data":"a9558cb631d7c4730d866835667ef8d08d2451bf2ce2c3449d92edae891af275"} Oct 30 22:05:42.804525 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:42.804496 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:05:42.823907 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:42.823825 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" podStartSLOduration=1.823809438 podStartE2EDuration="1.823809438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:42.823275041 +0000 UTC m=+752.346315773" watchObservedRunningTime="2026-10-30 22:05:42.823809438 +0000 UTC m=+752.346850158" Oct 30 22:05:43.807322 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:43.807275 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:05:48.812129 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:48.812097 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:05:48.812560 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:48.812535 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:05:51.619710 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:51.619680 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:05:58.813194 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:05:58.813105 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:06:00.352206 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:00.352165 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:06:03.658296 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:03.658262 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n"] Oct 30 22:06:03.661714 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:03.661693 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" Oct 30 22:06:03.672011 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:03.671980 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"switch-graph-3c7da-kube-rbac-proxy-sar-config\"" Oct 30 22:06:03.672011 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:03.671996 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"switch-graph-3c7da-serving-cert\"" Oct 30 22:06:03.673198 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:03.673175 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n"] Oct 30 22:06:03.694216 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:03.694193 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:06:03.756912 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:03.756876 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0ff95ba5-a945-4695-a432-3ab8af8093ad-proxy-tls\") pod \"switch-graph-3c7da-79f95f464b-ksn9n\" (UID: \"0ff95ba5-a945-4695-a432-3ab8af8093ad\") " pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" Oct 30 22:06:03.756912 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:03.756917 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ff95ba5-a945-4695-a432-3ab8af8093ad-openshift-service-ca-bundle\") pod \"switch-graph-3c7da-79f95f464b-ksn9n\" (UID: \"0ff95ba5-a945-4695-a432-3ab8af8093ad\") " pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" Oct 30 22:06:03.834163 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:03.834115 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:06:03.857819 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:03.857785 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0ff95ba5-a945-4695-a432-3ab8af8093ad-proxy-tls\") pod \"switch-graph-3c7da-79f95f464b-ksn9n\" (UID: \"0ff95ba5-a945-4695-a432-3ab8af8093ad\") " pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" Oct 30 22:06:03.857965 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:03.857827 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ff95ba5-a945-4695-a432-3ab8af8093ad-openshift-service-ca-bundle\") pod \"switch-graph-3c7da-79f95f464b-ksn9n\" (UID: \"0ff95ba5-a945-4695-a432-3ab8af8093ad\") " pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" Oct 30 22:06:03.858491 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:03.858474 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ff95ba5-a945-4695-a432-3ab8af8093ad-openshift-service-ca-bundle\") pod \"switch-graph-3c7da-79f95f464b-ksn9n\" (UID: \"0ff95ba5-a945-4695-a432-3ab8af8093ad\") " pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" Oct 30 22:06:03.860386 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:03.860366 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0ff95ba5-a945-4695-a432-3ab8af8093ad-proxy-tls\") pod \"switch-graph-3c7da-79f95f464b-ksn9n\" (UID: \"0ff95ba5-a945-4695-a432-3ab8af8093ad\") " pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" Oct 30 22:06:03.975714 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:03.975642 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" Oct 30 22:06:04.247998 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:04.247965 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n"] Oct 30 22:06:04.252603 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:06:04.252579 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff95ba5_a945_4695_a432_3ab8af8093ad.slice/crio-37d9092b938f98a0f43085a8e45e272a4d0265bdb010877a78778c2680c0d416 WatchSource:0}: Error finding container 37d9092b938f98a0f43085a8e45e272a4d0265bdb010877a78778c2680c0d416: Status 404 returned error can't find the container with id 37d9092b938f98a0f43085a8e45e272a4d0265bdb010877a78778c2680c0d416 Oct 30 22:06:04.896813 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:04.896780 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" event={"ID":"0ff95ba5-a945-4695-a432-3ab8af8093ad","Type":"ContainerStarted","Data":"0152a73207bc571198d9a88d1e17cc8b5b1377445b55e6e8a9d072639ef5ae9f"} Oct 30 22:06:04.897221 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:04.896830 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" event={"ID":"0ff95ba5-a945-4695-a432-3ab8af8093ad","Type":"ContainerStarted","Data":"37d9092b938f98a0f43085a8e45e272a4d0265bdb010877a78778c2680c0d416"} Oct 30 22:06:04.897221 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:04.896882 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" Oct 30 22:06:04.916149 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:04.916103 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" podStartSLOduration=1.9160921229999999 podStartE2EDuration="1.916092123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:06:04.915163846 +0000 UTC m=+774.438204594" watchObservedRunningTime="2026-10-30 22:06:04.916092123 +0000 UTC m=+774.439132855" Oct 30 22:06:04.986542 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:06:04.986505 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:06:08.812744 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:08.812698 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:06:10.908496 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:10.908468 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" Oct 30 22:06:18.812906 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:18.812841 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:06:28.812602 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:28.812561 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:06:34.986308 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:06:34.986266 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:06:38.813022 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:38.812994 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:06:51.661965 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:51.661929 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj"] Oct 30 22:06:51.667472 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:51.667437 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" Oct 30 22:06:51.691926 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:51.691899 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"sequence-graph-e9913-kube-rbac-proxy-sar-config\"" Oct 30 22:06:51.693063 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:51.693040 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"sequence-graph-e9913-serving-cert\"" Oct 30 22:06:51.695155 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:51.695133 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj"] Oct 30 22:06:51.731579 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:51.731545 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:06:51.733569 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:51.733548 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5d26654b-c9a9-448a-a226-81e5c6a7871f-proxy-tls\") pod \"sequence-graph-e9913-767b8c8c7d-kzdqj\" (UID: \"5d26654b-c9a9-448a-a226-81e5c6a7871f\") " pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" Oct 30 22:06:51.734029 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:51.734001 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d26654b-c9a9-448a-a226-81e5c6a7871f-openshift-service-ca-bundle\") pod \"sequence-graph-e9913-767b8c8c7d-kzdqj\" (UID: \"5d26654b-c9a9-448a-a226-81e5c6a7871f\") " pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" Oct 30 22:06:51.834650 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:51.834603 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d26654b-c9a9-448a-a226-81e5c6a7871f-openshift-service-ca-bundle\") pod \"sequence-graph-e9913-767b8c8c7d-kzdqj\" (UID: \"5d26654b-c9a9-448a-a226-81e5c6a7871f\") " pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" Oct 30 22:06:51.834816 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:51.834693 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5d26654b-c9a9-448a-a226-81e5c6a7871f-proxy-tls\") pod \"sequence-graph-e9913-767b8c8c7d-kzdqj\" (UID: \"5d26654b-c9a9-448a-a226-81e5c6a7871f\") " pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" Oct 30 22:06:51.835272 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:51.835254 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d26654b-c9a9-448a-a226-81e5c6a7871f-openshift-service-ca-bundle\") pod \"sequence-graph-e9913-767b8c8c7d-kzdqj\" (UID: \"5d26654b-c9a9-448a-a226-81e5c6a7871f\") " pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" Oct 30 22:06:51.837077 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:51.837059 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5d26654b-c9a9-448a-a226-81e5c6a7871f-proxy-tls\") pod \"sequence-graph-e9913-767b8c8c7d-kzdqj\" (UID: \"5d26654b-c9a9-448a-a226-81e5c6a7871f\") " pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" Oct 30 22:06:51.843792 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:51.843749 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:06:51.981063 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:51.981031 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" Oct 30 22:06:52.253043 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:52.253017 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj"] Oct 30 22:06:52.255752 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:06:52.255726 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d26654b_c9a9_448a_a226_81e5c6a7871f.slice/crio-87a8cbf283b7793f594eaeb18cfa16ab0fc78711599d17582b6c3877dd638f91 WatchSource:0}: Error finding container 87a8cbf283b7793f594eaeb18cfa16ab0fc78711599d17582b6c3877dd638f91: Status 404 returned error can't find the container with id 87a8cbf283b7793f594eaeb18cfa16ab0fc78711599d17582b6c3877dd638f91 Oct 30 22:06:53.097656 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:53.097617 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" event={"ID":"5d26654b-c9a9-448a-a226-81e5c6a7871f","Type":"ContainerStarted","Data":"7a73ac600f6076f7b4f2b5d44e557c31586e9944613f176e7b37b8e5daeb13c8"} Oct 30 22:06:53.098075 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:53.097674 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" event={"ID":"5d26654b-c9a9-448a-a226-81e5c6a7871f","Type":"ContainerStarted","Data":"87a8cbf283b7793f594eaeb18cfa16ab0fc78711599d17582b6c3877dd638f91"} Oct 30 22:06:53.098075 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:53.097723 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" Oct 30 22:06:53.116170 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:53.116126 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" podStartSLOduration=2.116114624 podStartE2EDuration="2.116114624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:06:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:06:53.115175099 +0000 UTC m=+822.638215852" watchObservedRunningTime="2026-10-30 22:06:53.116114624 +0000 UTC m=+822.639155356" Oct 30 22:06:59.107653 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:06:59.107618 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" Oct 30 22:07:00.457476 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:07:00.457438 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:04.991180 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:07:04.991146 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:07:34.985910 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:07:34.985872 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:08:00.459303 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:00.459248 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:04.986387 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:08:04.986344 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:08:10.682325 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:10.682291 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:08:10.684258 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:10.684226 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:08:34.985775 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:08:34.985729 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:08:43.435287 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.435252 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-7s6vk-q8p7z"] Oct 30 22:08:43.438901 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.438882 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:08:43.518659 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.518623 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-7s6vk-q8p7z"] Oct 30 22:08:43.577824 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.577795 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd7l8\" (UniqueName: \"kubernetes.io/projected/39dc3095-a843-42c3-abce-2c44331991ec-kube-api-access-dd7l8\") pod \"periodic-gathering-7s6vk-q8p7z\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:08:43.577824 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.577824 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39dc3095-a843-42c3-abce-2c44331991ec-trusted-ca-bundle\") pod \"periodic-gathering-7s6vk-q8p7z\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:08:43.578036 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.577851 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39dc3095-a843-42c3-abce-2c44331991ec-service-ca-bundle\") pod \"periodic-gathering-7s6vk-q8p7z\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:08:43.578078 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.578031 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/39dc3095-a843-42c3-abce-2c44331991ec-archives-path\") pod \"periodic-gathering-7s6vk-q8p7z\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:08:43.678872 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.678835 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/39dc3095-a843-42c3-abce-2c44331991ec-archives-path\") pod \"periodic-gathering-7s6vk-q8p7z\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:08:43.678968 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.678895 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd7l8\" (UniqueName: \"kubernetes.io/projected/39dc3095-a843-42c3-abce-2c44331991ec-kube-api-access-dd7l8\") pod \"periodic-gathering-7s6vk-q8p7z\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:08:43.678968 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.678923 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39dc3095-a843-42c3-abce-2c44331991ec-trusted-ca-bundle\") pod \"periodic-gathering-7s6vk-q8p7z\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:08:43.678968 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.678957 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39dc3095-a843-42c3-abce-2c44331991ec-service-ca-bundle\") pod \"periodic-gathering-7s6vk-q8p7z\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:08:43.679354 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.679329 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/39dc3095-a843-42c3-abce-2c44331991ec-archives-path\") pod \"periodic-gathering-7s6vk-q8p7z\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:08:43.679569 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.679550 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39dc3095-a843-42c3-abce-2c44331991ec-service-ca-bundle\") pod \"periodic-gathering-7s6vk-q8p7z\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:08:43.679731 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.679710 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39dc3095-a843-42c3-abce-2c44331991ec-trusted-ca-bundle\") pod \"periodic-gathering-7s6vk-q8p7z\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:08:43.691924 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.691873 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd7l8\" (UniqueName: \"kubernetes.io/projected/39dc3095-a843-42c3-abce-2c44331991ec-kube-api-access-dd7l8\") pod \"periodic-gathering-7s6vk-q8p7z\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:08:43.750643 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:43.750623 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:08:44.024795 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:44.024765 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-7s6vk-q8p7z"] Oct 30 22:08:44.029661 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:08:44.029632 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39dc3095_a843_42c3_abce_2c44331991ec.slice/crio-6ba671c997c533bc084a4f10884c5387044856b4406c145494bc09e23d309a25 WatchSource:0}: Error finding container 6ba671c997c533bc084a4f10884c5387044856b4406c145494bc09e23d309a25: Status 404 returned error can't find the container with id 6ba671c997c533bc084a4f10884c5387044856b4406c145494bc09e23d309a25 Oct 30 22:08:44.567797 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:44.567759 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" event={"ID":"39dc3095-a843-42c3-abce-2c44331991ec","Type":"ContainerStarted","Data":"91e4b622f0b054d8040c37b5907c4cbd98c74a6d9edb059ae57f4056f24ae678"} Oct 30 22:08:44.568225 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:44.567813 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" event={"ID":"39dc3095-a843-42c3-abce-2c44331991ec","Type":"ContainerStarted","Data":"6ba671c997c533bc084a4f10884c5387044856b4406c145494bc09e23d309a25"} Oct 30 22:08:44.590522 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:08:44.590473 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" podStartSLOduration=1.5904598380000001 podStartE2EDuration="1.590459838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:44.58981348 +0000 UTC m=+934.112854197" watchObservedRunningTime="2026-10-30 22:08:44.590459838 +0000 UTC m=+934.113500570" Oct 30 22:09:00.517319 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:09:00.517235 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:04.987844 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:09:04.987805 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:09:34.986632 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:09:34.986596 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:09:46.093913 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:09:46.093877 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:00.595388 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:00.595347 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:04.986143 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:10:04.986106 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:10:12.944875 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:12.944823 5052 generic.go:356] "Generic (PLEG): container finished" podID="39dc3095-a843-42c3-abce-2c44331991ec" containerID="91e4b622f0b054d8040c37b5907c4cbd98c74a6d9edb059ae57f4056f24ae678" exitCode=0 Oct 30 22:10:12.945252 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:12.944897 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" event={"ID":"39dc3095-a843-42c3-abce-2c44331991ec","Type":"ContainerDied","Data":"91e4b622f0b054d8040c37b5907c4cbd98c74a6d9edb059ae57f4056f24ae678"} Oct 30 22:10:14.085554 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.085532 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:10:14.202132 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.202060 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39dc3095-a843-42c3-abce-2c44331991ec-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39dc3095-a843-42c3-abce-2c44331991ec-service-ca-bundle\") pod \"39dc3095-a843-42c3-abce-2c44331991ec\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " Oct 30 22:10:14.202132 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.202113 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39dc3095-a843-42c3-abce-2c44331991ec-kube-api-access-dd7l8\" (UniqueName: \"kubernetes.io/projected/39dc3095-a843-42c3-abce-2c44331991ec-kube-api-access-dd7l8\") pod \"39dc3095-a843-42c3-abce-2c44331991ec\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " Oct 30 22:10:14.202338 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.202160 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39dc3095-a843-42c3-abce-2c44331991ec-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/39dc3095-a843-42c3-abce-2c44331991ec-archives-path\") pod \"39dc3095-a843-42c3-abce-2c44331991ec\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " Oct 30 22:10:14.202338 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.202206 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39dc3095-a843-42c3-abce-2c44331991ec-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39dc3095-a843-42c3-abce-2c44331991ec-trusted-ca-bundle\") pod \"39dc3095-a843-42c3-abce-2c44331991ec\" (UID: \"39dc3095-a843-42c3-abce-2c44331991ec\") " Oct 30 22:10:14.202537 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.202505 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39dc3095-a843-42c3-abce-2c44331991ec-archives-path" pod "39dc3095-a843-42c3-abce-2c44331991ec" (UID: "39dc3095-a843-42c3-abce-2c44331991ec"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:10:14.202667 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.202565 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39dc3095-a843-42c3-abce-2c44331991ec-service-ca-bundle" pod "39dc3095-a843-42c3-abce-2c44331991ec" (UID: "39dc3095-a843-42c3-abce-2c44331991ec"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:10:14.202667 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.202621 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39dc3095-a843-42c3-abce-2c44331991ec-trusted-ca-bundle" pod "39dc3095-a843-42c3-abce-2c44331991ec" (UID: "39dc3095-a843-42c3-abce-2c44331991ec"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:10:14.204271 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.204251 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39dc3095-a843-42c3-abce-2c44331991ec-kube-api-access-dd7l8" pod "39dc3095-a843-42c3-abce-2c44331991ec" (UID: "39dc3095-a843-42c3-abce-2c44331991ec"). InnerVolumeSpecName "kube-api-access-dd7l8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:10:14.302825 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.302801 5052 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/39dc3095-a843-42c3-abce-2c44331991ec-archives-path\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:10:14.302825 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.302824 5052 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39dc3095-a843-42c3-abce-2c44331991ec-trusted-ca-bundle\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:10:14.302977 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.302834 5052 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39dc3095-a843-42c3-abce-2c44331991ec-service-ca-bundle\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:10:14.302977 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.302843 5052 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd7l8\" (UniqueName: \"kubernetes.io/projected/39dc3095-a843-42c3-abce-2c44331991ec-kube-api-access-dd7l8\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:10:14.954491 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.954418 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" Oct 30 22:10:14.954491 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.954416 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7s6vk-q8p7z" event={"ID":"39dc3095-a843-42c3-abce-2c44331991ec","Type":"ContainerDied","Data":"6ba671c997c533bc084a4f10884c5387044856b4406c145494bc09e23d309a25"} Oct 30 22:10:14.954663 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:14.954528 5052 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ba671c997c533bc084a4f10884c5387044856b4406c145494bc09e23d309a25" Oct 30 22:10:15.277491 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:15.277457 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:15.385838 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:10:15.385806 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:34.988841 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:10:34.988805 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:11:00.642304 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:11:00.642261 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:11:04.986061 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:11:04.986022 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:11:34.986083 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:11:34.986046 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:12:00.689047 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:12:00.688954 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:04.986293 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:12:04.986259 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:12:15.114559 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:12:15.114519 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:34.985731 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:12:34.985691 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:13:00.740253 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:13:00.740217 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:13:04.985944 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:13:04.985910 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:13:10.718420 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:13:10.718392 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:13:10.721893 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:13:10.721849 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:13:34.986346 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:13:34.986309 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:14:00.790344 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:00.790307 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:04.986333 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:14:04.986299 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:14:19.432346 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:19.432304 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75"] Oct 30 22:14:19.432925 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:19.432575 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kserve-container" containerID="cri-o://aacc0b03fe067964883678ef026f0661a17cd4319383df47ca8c8dae09442dce" gracePeriod=30 Oct 30 22:14:19.432925 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:19.432651 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kube-rbac-proxy" containerID="cri-o://57f1a5eaab755d17abf79a6c57bda88a6eca6811b98558031a20ba4959809238" gracePeriod=30 Oct 30 22:14:19.435886 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:19.435730 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:19.542927 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:19.542905 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:20.016503 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:20.016465 5052 generic.go:356] "Generic (PLEG): container finished" podID="29aae98b-345c-4f87-9469-4e1c16941e33" containerID="57f1a5eaab755d17abf79a6c57bda88a6eca6811b98558031a20ba4959809238" exitCode=0 Oct 30 22:14:20.016668 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:20.016538 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" event={"ID":"29aae98b-345c-4f87-9469-4e1c16941e33","Type":"ContainerDied","Data":"57f1a5eaab755d17abf79a6c57bda88a6eca6811b98558031a20ba4959809238"} Oct 30 22:14:21.614256 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:21.614214 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused" Oct 30 22:14:21.619621 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:21.619597 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused" Oct 30 22:14:22.481208 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:22.481184 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:14:22.503147 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:22.503096 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/29aae98b-345c-4f87-9469-4e1c16941e33-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/29aae98b-345c-4f87-9469-4e1c16941e33-kube-rbac-proxy-sar-config\") pod \"29aae98b-345c-4f87-9469-4e1c16941e33\" (UID: \"29aae98b-345c-4f87-9469-4e1c16941e33\") " Oct 30 22:14:22.503310 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:22.503159 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/29aae98b-345c-4f87-9469-4e1c16941e33-proxy-tls\" (UniqueName: \"kubernetes.io/secret/29aae98b-345c-4f87-9469-4e1c16941e33-proxy-tls\") pod \"29aae98b-345c-4f87-9469-4e1c16941e33\" (UID: \"29aae98b-345c-4f87-9469-4e1c16941e33\") " Oct 30 22:14:22.503310 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:22.503246 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29aae98b-345c-4f87-9469-4e1c16941e33-kube-api-access-ldffw\" (UniqueName: \"kubernetes.io/projected/29aae98b-345c-4f87-9469-4e1c16941e33-kube-api-access-ldffw\") pod \"29aae98b-345c-4f87-9469-4e1c16941e33\" (UID: \"29aae98b-345c-4f87-9469-4e1c16941e33\") " Oct 30 22:14:22.503556 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:22.503521 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29aae98b-345c-4f87-9469-4e1c16941e33-kube-rbac-proxy-sar-config" pod "29aae98b-345c-4f87-9469-4e1c16941e33" (UID: "29aae98b-345c-4f87-9469-4e1c16941e33"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:14:22.505814 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:22.505786 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29aae98b-345c-4f87-9469-4e1c16941e33-kube-api-access-ldffw" pod "29aae98b-345c-4f87-9469-4e1c16941e33" (UID: "29aae98b-345c-4f87-9469-4e1c16941e33"). InnerVolumeSpecName "kube-api-access-ldffw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:14:22.506977 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:22.506950 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29aae98b-345c-4f87-9469-4e1c16941e33-proxy-tls" pod "29aae98b-345c-4f87-9469-4e1c16941e33" (UID: "29aae98b-345c-4f87-9469-4e1c16941e33"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:14:22.604624 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:22.604589 5052 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/29aae98b-345c-4f87-9469-4e1c16941e33-kube-rbac-proxy-sar-config\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:14:22.604624 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:22.604619 5052 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/29aae98b-345c-4f87-9469-4e1c16941e33-proxy-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:14:22.604841 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:22.604634 5052 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldffw\" (UniqueName: \"kubernetes.io/projected/29aae98b-345c-4f87-9469-4e1c16941e33-kube-api-access-ldffw\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:14:23.031165 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:23.031129 5052 generic.go:356] "Generic (PLEG): container finished" podID="29aae98b-345c-4f87-9469-4e1c16941e33" containerID="aacc0b03fe067964883678ef026f0661a17cd4319383df47ca8c8dae09442dce" exitCode=0 Oct 30 22:14:23.031650 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:23.031179 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" Oct 30 22:14:23.031650 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:23.031212 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" event={"ID":"29aae98b-345c-4f87-9469-4e1c16941e33","Type":"ContainerDied","Data":"aacc0b03fe067964883678ef026f0661a17cd4319383df47ca8c8dae09442dce"} Oct 30 22:14:23.031650 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:23.031289 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75" event={"ID":"29aae98b-345c-4f87-9469-4e1c16941e33","Type":"ContainerDied","Data":"1e3c4b0f27e0fd283d859a1b0df32856f12c28b7000fd2628c20427eace86b79"} Oct 30 22:14:23.031650 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:23.031335 5052 scope.go:122] "RemoveContainer" containerID="57f1a5eaab755d17abf79a6c57bda88a6eca6811b98558031a20ba4959809238" Oct 30 22:14:23.040101 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:23.040082 5052 scope.go:122] "RemoveContainer" containerID="aacc0b03fe067964883678ef026f0661a17cd4319383df47ca8c8dae09442dce" Oct 30 22:14:23.047652 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:23.047630 5052 scope.go:122] "RemoveContainer" containerID="57f1a5eaab755d17abf79a6c57bda88a6eca6811b98558031a20ba4959809238" Oct 30 22:14:23.047962 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:14:23.047938 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57f1a5eaab755d17abf79a6c57bda88a6eca6811b98558031a20ba4959809238\": container with ID starting with 57f1a5eaab755d17abf79a6c57bda88a6eca6811b98558031a20ba4959809238 not found: ID does not exist" containerID="57f1a5eaab755d17abf79a6c57bda88a6eca6811b98558031a20ba4959809238" Oct 30 22:14:23.048076 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:23.047969 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57f1a5eaab755d17abf79a6c57bda88a6eca6811b98558031a20ba4959809238"} err="failed to get container status \"57f1a5eaab755d17abf79a6c57bda88a6eca6811b98558031a20ba4959809238\": rpc error: code = NotFound desc = could not find container \"57f1a5eaab755d17abf79a6c57bda88a6eca6811b98558031a20ba4959809238\": container with ID starting with 57f1a5eaab755d17abf79a6c57bda88a6eca6811b98558031a20ba4959809238 not found: ID does not exist" Oct 30 22:14:23.048076 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:23.047986 5052 scope.go:122] "RemoveContainer" containerID="aacc0b03fe067964883678ef026f0661a17cd4319383df47ca8c8dae09442dce" Oct 30 22:14:23.048273 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:14:23.048246 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aacc0b03fe067964883678ef026f0661a17cd4319383df47ca8c8dae09442dce\": container with ID starting with aacc0b03fe067964883678ef026f0661a17cd4319383df47ca8c8dae09442dce not found: ID does not exist" containerID="aacc0b03fe067964883678ef026f0661a17cd4319383df47ca8c8dae09442dce" Oct 30 22:14:23.048393 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:23.048279 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aacc0b03fe067964883678ef026f0661a17cd4319383df47ca8c8dae09442dce"} err="failed to get container status \"aacc0b03fe067964883678ef026f0661a17cd4319383df47ca8c8dae09442dce\": rpc error: code = NotFound desc = could not find container \"aacc0b03fe067964883678ef026f0661a17cd4319383df47ca8c8dae09442dce\": container with ID starting with aacc0b03fe067964883678ef026f0661a17cd4319383df47ca8c8dae09442dce not found: ID does not exist" Oct 30 22:14:23.049429 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:23.049412 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75"] Oct 30 22:14:23.053490 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:23.053470 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-3c7da-predictor-6c85fb6c6d-6xj75"] Oct 30 22:14:24.607955 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.607925 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" path="/var/lib/kubelet/pods/29aae98b-345c-4f87-9469-4e1c16941e33/volumes" Oct 30 22:14:24.805518 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.805479 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:24.833448 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.833424 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c"] Oct 30 22:14:24.833965 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.833948 5052 cpu_manager.go:414] "containerMap: removing container" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kserve-container" Oct 30 22:14:24.834013 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.833968 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kserve-container" Oct 30 22:14:24.834013 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.833992 5052 cpu_manager.go:414] "containerMap: removing container" podUID="39dc3095-a843-42c3-abce-2c44331991ec" containerName="insights-gathering" Oct 30 22:14:24.834013 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.834002 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39dc3095-a843-42c3-abce-2c44331991ec" containerName="insights-gathering" Oct 30 22:14:24.834108 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.834018 5052 cpu_manager.go:414] "containerMap: removing container" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kube-rbac-proxy" Oct 30 22:14:24.834108 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.834027 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kube-rbac-proxy" Oct 30 22:14:24.834167 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.834127 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kserve-container" Oct 30 22:14:24.834167 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.834139 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="39dc3095-a843-42c3-abce-2c44331991ec" containerName="insights-gathering" Oct 30 22:14:24.834167 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.834148 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="29aae98b-345c-4f87-9469-4e1c16941e33" containerName="kube-rbac-proxy" Oct 30 22:14:24.838881 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.838852 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:14:24.845688 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.845665 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"success-200-isvc-08888-predictor-serving-cert\"" Oct 30 22:14:24.846589 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.846568 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"success-200-isvc-08888-kube-rbac-proxy-sar-config\"" Oct 30 22:14:24.846867 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.846836 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"kube-root-ca.crt\"" Oct 30 22:14:24.848121 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.848103 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c"] Oct 30 22:14:24.922572 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.922507 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqzmw\" (UniqueName: \"kubernetes.io/projected/c540ef0b-0264-4e80-92c0-65f5ad80fba7-kube-api-access-pqzmw\") pod \"success-200-isvc-08888-predictor-dbb5fdc6-rp62c\" (UID: \"c540ef0b-0264-4e80-92c0-65f5ad80fba7\") " pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:14:24.922572 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.922540 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c540ef0b-0264-4e80-92c0-65f5ad80fba7-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-08888-predictor-dbb5fdc6-rp62c\" (UID: \"c540ef0b-0264-4e80-92c0-65f5ad80fba7\") " pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:14:24.922732 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.922636 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c540ef0b-0264-4e80-92c0-65f5ad80fba7-proxy-tls\") pod \"success-200-isvc-08888-predictor-dbb5fdc6-rp62c\" (UID: \"c540ef0b-0264-4e80-92c0-65f5ad80fba7\") " pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:14:24.926622 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:24.926594 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:25.023454 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:25.023424 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c540ef0b-0264-4e80-92c0-65f5ad80fba7-proxy-tls\") pod \"success-200-isvc-08888-predictor-dbb5fdc6-rp62c\" (UID: \"c540ef0b-0264-4e80-92c0-65f5ad80fba7\") " pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:14:25.023612 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:25.023487 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqzmw\" (UniqueName: \"kubernetes.io/projected/c540ef0b-0264-4e80-92c0-65f5ad80fba7-kube-api-access-pqzmw\") pod \"success-200-isvc-08888-predictor-dbb5fdc6-rp62c\" (UID: \"c540ef0b-0264-4e80-92c0-65f5ad80fba7\") " pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:14:25.023612 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:25.023510 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c540ef0b-0264-4e80-92c0-65f5ad80fba7-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-08888-predictor-dbb5fdc6-rp62c\" (UID: \"c540ef0b-0264-4e80-92c0-65f5ad80fba7\") " pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:14:25.024237 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:25.024216 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c540ef0b-0264-4e80-92c0-65f5ad80fba7-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-08888-predictor-dbb5fdc6-rp62c\" (UID: \"c540ef0b-0264-4e80-92c0-65f5ad80fba7\") " pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:14:25.025873 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:25.025834 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c540ef0b-0264-4e80-92c0-65f5ad80fba7-proxy-tls\") pod \"success-200-isvc-08888-predictor-dbb5fdc6-rp62c\" (UID: \"c540ef0b-0264-4e80-92c0-65f5ad80fba7\") " pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:14:25.035351 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:25.035330 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqzmw\" (UniqueName: \"kubernetes.io/projected/c540ef0b-0264-4e80-92c0-65f5ad80fba7-kube-api-access-pqzmw\") pod \"success-200-isvc-08888-predictor-dbb5fdc6-rp62c\" (UID: \"c540ef0b-0264-4e80-92c0-65f5ad80fba7\") " pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:14:25.038672 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:25.038643 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:25.153874 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:25.153835 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:14:25.170182 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:25.170152 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:25.429916 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:25.429888 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c"] Oct 30 22:14:25.433400 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:14:25.433377 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc540ef0b_0264_4e80_92c0_65f5ad80fba7.slice/crio-3730e70ed43af7e88c4f4035b2c86a7bb49dab110fc50a1d52c7d4e37000e7c2 WatchSource:0}: Error finding container 3730e70ed43af7e88c4f4035b2c86a7bb49dab110fc50a1d52c7d4e37000e7c2: Status 404 returned error can't find the container with id 3730e70ed43af7e88c4f4035b2c86a7bb49dab110fc50a1d52c7d4e37000e7c2 Oct 30 22:14:26.047250 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:26.047219 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" event={"ID":"c540ef0b-0264-4e80-92c0-65f5ad80fba7","Type":"ContainerStarted","Data":"86b373c4a5893709c4246b481c04ec7c30f4d14b20bd28b8df07cac90739103c"} Oct 30 22:14:26.047633 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:26.047279 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" event={"ID":"c540ef0b-0264-4e80-92c0-65f5ad80fba7","Type":"ContainerStarted","Data":"e640bc97bb6a6e6579be46249568ccde24e92f07d90852efa6e0325b6c241fde"} Oct 30 22:14:26.047633 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:26.047306 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" event={"ID":"c540ef0b-0264-4e80-92c0-65f5ad80fba7","Type":"ContainerStarted","Data":"3730e70ed43af7e88c4f4035b2c86a7bb49dab110fc50a1d52c7d4e37000e7c2"} Oct 30 22:14:26.047633 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:26.047331 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:14:26.047633 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:26.047381 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:14:26.048829 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:26.048806 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused" Oct 30 22:14:26.075418 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:26.075375 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" podStartSLOduration=2.075364688 podStartE2EDuration="2.075364688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:26.07426277 +0000 UTC m=+1275.597303503" watchObservedRunningTime="2026-10-30 22:14:26.075364688 +0000 UTC m=+1275.598405421" Oct 30 22:14:27.051344 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:27.051306 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused" Oct 30 22:14:32.056175 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:32.056144 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:14:32.056682 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:32.056651 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused" Oct 30 22:14:34.986575 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:14:34.986539 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:14:42.056876 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:42.056822 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused" Oct 30 22:14:52.057247 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:14:52.057204 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused" Oct 30 22:15:00.848021 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:00.847912 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:02.056903 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:02.056842 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused" Oct 30 22:15:04.986183 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:15:04.986151 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:15:06.900006 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:06.899951 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:07.783066 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:07.783035 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2"] Oct 30 22:15:07.783278 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:07.783255 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kserve-container" containerID="cri-o://5c54393a175620ce3be1428157e2494f88c5bceb0216a6bbbf4120fffcc7c2ef" gracePeriod=30 Oct 30 22:15:07.783344 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:07.783325 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kube-rbac-proxy" containerID="cri-o://d878130e5e575f0fee1bad7b7e0a7e292981454e907180d9c656c97fee2cc896" gracePeriod=30 Oct 30 22:15:07.813341 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:07.813317 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:07.917842 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:07.917817 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:08.233963 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:08.233933 5052 generic.go:356] "Generic (PLEG): container finished" podID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerID="d878130e5e575f0fee1bad7b7e0a7e292981454e907180d9c656c97fee2cc896" exitCode=0 Oct 30 22:15:08.234118 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:08.233992 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" event={"ID":"ecb560c7-e0d0-4bfb-8844-c407c365cee6","Type":"ContainerDied","Data":"d878130e5e575f0fee1bad7b7e0a7e292981454e907180d9c656c97fee2cc896"} Oct 30 22:15:08.808171 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:08.808127 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.37:8643/healthz\": dial tcp 10.132.0.37:8643: connect: connection refused" Oct 30 22:15:08.813472 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:08.813443 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:15:10.627035 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:10.627012 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:15:10.724562 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:10.724493 5052 scope.go:122] "RemoveContainer" containerID="d878130e5e575f0fee1bad7b7e0a7e292981454e907180d9c656c97fee2cc896" Oct 30 22:15:10.732630 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:10.732611 5052 scope.go:122] "RemoveContainer" containerID="5c54393a175620ce3be1428157e2494f88c5bceb0216a6bbbf4120fffcc7c2ef" Oct 30 22:15:10.793350 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:10.793323 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ecb560c7-e0d0-4bfb-8844-c407c365cee6-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ecb560c7-e0d0-4bfb-8844-c407c365cee6-kube-rbac-proxy-sar-config\") pod \"ecb560c7-e0d0-4bfb-8844-c407c365cee6\" (UID: \"ecb560c7-e0d0-4bfb-8844-c407c365cee6\") " Oct 30 22:15:10.793533 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:10.793515 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ecb560c7-e0d0-4bfb-8844-c407c365cee6-kube-api-access-m6trj\" (UniqueName: \"kubernetes.io/projected/ecb560c7-e0d0-4bfb-8844-c407c365cee6-kube-api-access-m6trj\") pod \"ecb560c7-e0d0-4bfb-8844-c407c365cee6\" (UID: \"ecb560c7-e0d0-4bfb-8844-c407c365cee6\") " Oct 30 22:15:10.793593 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:10.793572 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ecb560c7-e0d0-4bfb-8844-c407c365cee6-proxy-tls\" (UniqueName: \"kubernetes.io/secret/ecb560c7-e0d0-4bfb-8844-c407c365cee6-proxy-tls\") pod \"ecb560c7-e0d0-4bfb-8844-c407c365cee6\" (UID: \"ecb560c7-e0d0-4bfb-8844-c407c365cee6\") " Oct 30 22:15:10.793658 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:10.793610 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecb560c7-e0d0-4bfb-8844-c407c365cee6-kube-rbac-proxy-sar-config" pod "ecb560c7-e0d0-4bfb-8844-c407c365cee6" (UID: "ecb560c7-e0d0-4bfb-8844-c407c365cee6"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:15:10.793761 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:10.793747 5052 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ecb560c7-e0d0-4bfb-8844-c407c365cee6-kube-rbac-proxy-sar-config\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:15:10.795549 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:10.795524 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecb560c7-e0d0-4bfb-8844-c407c365cee6-proxy-tls" pod "ecb560c7-e0d0-4bfb-8844-c407c365cee6" (UID: "ecb560c7-e0d0-4bfb-8844-c407c365cee6"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:15:10.795650 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:10.795606 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecb560c7-e0d0-4bfb-8844-c407c365cee6-kube-api-access-m6trj" pod "ecb560c7-e0d0-4bfb-8844-c407c365cee6" (UID: "ecb560c7-e0d0-4bfb-8844-c407c365cee6"). InnerVolumeSpecName "kube-api-access-m6trj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:15:10.895007 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:10.894979 5052 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ecb560c7-e0d0-4bfb-8844-c407c365cee6-proxy-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:15:10.895007 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:10.895007 5052 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6trj\" (UniqueName: \"kubernetes.io/projected/ecb560c7-e0d0-4bfb-8844-c407c365cee6-kube-api-access-m6trj\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:15:11.249239 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:11.249191 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" event={"ID":"ecb560c7-e0d0-4bfb-8844-c407c365cee6","Type":"ContainerDied","Data":"5c54393a175620ce3be1428157e2494f88c5bceb0216a6bbbf4120fffcc7c2ef"} Oct 30 22:15:11.249239 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:11.249217 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" Oct 30 22:15:11.249508 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:11.249279 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2" event={"ID":"ecb560c7-e0d0-4bfb-8844-c407c365cee6","Type":"ContainerDied","Data":"a9558cb631d7c4730d866835667ef8d08d2451bf2ce2c3449d92edae891af275"} Oct 30 22:15:11.282246 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:11.282221 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2"] Oct 30 22:15:11.286680 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:11.286661 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-e9913-predictor-97cc787fd-c8vb2"] Oct 30 22:15:12.057306 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:12.057264 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused" Oct 30 22:15:12.607618 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:12.607576 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" path="/var/lib/kubelet/pods/ecb560c7-e0d0-4bfb-8844-c407c365cee6/volumes" Oct 30 22:15:13.172570 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.172538 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w"] Oct 30 22:15:13.172946 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.172910 5052 cpu_manager.go:414] "containerMap: removing container" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kube-rbac-proxy" Oct 30 22:15:13.172946 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.172923 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kube-rbac-proxy" Oct 30 22:15:13.172946 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.172945 5052 cpu_manager.go:414] "containerMap: removing container" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kserve-container" Oct 30 22:15:13.173055 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.172949 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kserve-container" Oct 30 22:15:13.173055 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.173011 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kube-rbac-proxy" Oct 30 22:15:13.173055 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.173022 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="ecb560c7-e0d0-4bfb-8844-c407c365cee6" containerName="kserve-container" Oct 30 22:15:13.177312 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.177292 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:15:13.179845 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.179812 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:13.185210 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.185187 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"success-200-isvc-47126-kube-rbac-proxy-sar-config\"" Oct 30 22:15:13.186228 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.186207 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"success-200-isvc-47126-predictor-serving-cert\"" Oct 30 22:15:13.186370 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.186256 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"kube-root-ca.crt\"" Oct 30 22:15:13.188186 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.188168 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w"] Oct 30 22:15:13.214085 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.214057 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c9e6854-99a1-406d-b968-fe1d921a38b7-proxy-tls\") pod \"success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w\" (UID: \"0c9e6854-99a1-406d-b968-fe1d921a38b7\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:15:13.214219 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.214089 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4rgt\" (UniqueName: \"kubernetes.io/projected/0c9e6854-99a1-406d-b968-fe1d921a38b7-kube-api-access-v4rgt\") pod \"success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w\" (UID: \"0c9e6854-99a1-406d-b968-fe1d921a38b7\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:15:13.214219 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.214183 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0c9e6854-99a1-406d-b968-fe1d921a38b7-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w\" (UID: \"0c9e6854-99a1-406d-b968-fe1d921a38b7\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:15:13.287069 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.287039 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:13.314709 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.314683 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c9e6854-99a1-406d-b968-fe1d921a38b7-proxy-tls\") pod \"success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w\" (UID: \"0c9e6854-99a1-406d-b968-fe1d921a38b7\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:15:13.314853 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.314712 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4rgt\" (UniqueName: \"kubernetes.io/projected/0c9e6854-99a1-406d-b968-fe1d921a38b7-kube-api-access-v4rgt\") pod \"success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w\" (UID: \"0c9e6854-99a1-406d-b968-fe1d921a38b7\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:15:13.314942 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.314850 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0c9e6854-99a1-406d-b968-fe1d921a38b7-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w\" (UID: \"0c9e6854-99a1-406d-b968-fe1d921a38b7\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:15:13.315479 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.315457 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0c9e6854-99a1-406d-b968-fe1d921a38b7-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w\" (UID: \"0c9e6854-99a1-406d-b968-fe1d921a38b7\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:15:13.317470 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.317447 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c9e6854-99a1-406d-b968-fe1d921a38b7-proxy-tls\") pod \"success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w\" (UID: \"0c9e6854-99a1-406d-b968-fe1d921a38b7\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:15:13.329733 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.329702 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4rgt\" (UniqueName: \"kubernetes.io/projected/0c9e6854-99a1-406d-b968-fe1d921a38b7-kube-api-access-v4rgt\") pod \"success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w\" (UID: \"0c9e6854-99a1-406d-b968-fe1d921a38b7\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:15:13.410428 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.410383 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:13.493396 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.493369 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:15:13.542181 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.542147 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:13.770266 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:13.770186 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w"] Oct 30 22:15:13.774255 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:15:13.774227 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c9e6854_99a1_406d_b968_fe1d921a38b7.slice/crio-88e6e0c8790aea3fcb2f0b9c4b7af6356263fcd75ac08a57c1ed4178df230971 WatchSource:0}: Error finding container 88e6e0c8790aea3fcb2f0b9c4b7af6356263fcd75ac08a57c1ed4178df230971: Status 404 returned error can't find the container with id 88e6e0c8790aea3fcb2f0b9c4b7af6356263fcd75ac08a57c1ed4178df230971 Oct 30 22:15:14.264755 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:14.264717 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" event={"ID":"0c9e6854-99a1-406d-b968-fe1d921a38b7","Type":"ContainerStarted","Data":"d0e13919252bc07b559a0a75e6f9c204e59e7a9efd1c4827b01b170dc423d87e"} Oct 30 22:15:14.265201 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:14.264819 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" event={"ID":"0c9e6854-99a1-406d-b968-fe1d921a38b7","Type":"ContainerStarted","Data":"4af5898574a86f95238690e473876d829cabb6d7dc56c64377379fc5bca9e428"} Oct 30 22:15:14.265201 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:14.264880 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:15:14.265201 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:14.264916 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" event={"ID":"0c9e6854-99a1-406d-b968-fe1d921a38b7","Type":"ContainerStarted","Data":"88e6e0c8790aea3fcb2f0b9c4b7af6356263fcd75ac08a57c1ed4178df230971"} Oct 30 22:15:14.285571 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:14.285521 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" podStartSLOduration=1.285507145 podStartE2EDuration="1.285507145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:14.284293677 +0000 UTC m=+1323.807334410" watchObservedRunningTime="2026-10-30 22:15:14.285507145 +0000 UTC m=+1323.808547927" Oct 30 22:15:15.268989 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:15.268953 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:15:15.270231 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:15.270203 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused" Oct 30 22:15:16.273329 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:16.273285 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused" Oct 30 22:15:21.278201 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:21.278174 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:15:21.278633 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:21.278608 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused" Oct 30 22:15:22.057524 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:22.057496 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:15:31.278809 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:31.278760 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused" Oct 30 22:15:34.989479 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:15:34.989438 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:15:35.049179 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:35.049140 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:35.290638 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:35.290541 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:41.279601 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:41.279561 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused" Oct 30 22:15:45.859147 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:45.859111 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c"] Oct 30 22:15:45.859546 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:45.859393 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kserve-container" containerID="cri-o://e640bc97bb6a6e6579be46249568ccde24e92f07d90852efa6e0325b6c241fde" gracePeriod=30 Oct 30 22:15:45.859546 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:45.859439 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kube-rbac-proxy" containerID="cri-o://86b373c4a5893709c4246b481c04ec7c30f4d14b20bd28b8df07cac90739103c" gracePeriod=30 Oct 30 22:15:45.885836 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:45.885790 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:45.998011 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:45.997980 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:46.401340 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:46.401310 5052 generic.go:356] "Generic (PLEG): container finished" podID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerID="86b373c4a5893709c4246b481c04ec7c30f4d14b20bd28b8df07cac90739103c" exitCode=0 Oct 30 22:15:46.401505 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:46.401379 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" event={"ID":"c540ef0b-0264-4e80-92c0-65f5ad80fba7","Type":"ContainerDied","Data":"86b373c4a5893709c4246b481c04ec7c30f4d14b20bd28b8df07cac90739103c"} Oct 30 22:15:47.052447 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:47.052406 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.41:8643/healthz\": dial tcp 10.132.0.41:8643: connect: connection refused" Oct 30 22:15:49.203882 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.203844 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:15:49.308707 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.308681 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c540ef0b-0264-4e80-92c0-65f5ad80fba7-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c540ef0b-0264-4e80-92c0-65f5ad80fba7-kube-rbac-proxy-sar-config\") pod \"c540ef0b-0264-4e80-92c0-65f5ad80fba7\" (UID: \"c540ef0b-0264-4e80-92c0-65f5ad80fba7\") " Oct 30 22:15:49.308937 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.308764 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c540ef0b-0264-4e80-92c0-65f5ad80fba7-kube-api-access-pqzmw\" (UniqueName: \"kubernetes.io/projected/c540ef0b-0264-4e80-92c0-65f5ad80fba7-kube-api-access-pqzmw\") pod \"c540ef0b-0264-4e80-92c0-65f5ad80fba7\" (UID: \"c540ef0b-0264-4e80-92c0-65f5ad80fba7\") " Oct 30 22:15:49.308937 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.308818 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c540ef0b-0264-4e80-92c0-65f5ad80fba7-proxy-tls\" (UniqueName: \"kubernetes.io/secret/c540ef0b-0264-4e80-92c0-65f5ad80fba7-proxy-tls\") pod \"c540ef0b-0264-4e80-92c0-65f5ad80fba7\" (UID: \"c540ef0b-0264-4e80-92c0-65f5ad80fba7\") " Oct 30 22:15:49.309099 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.309012 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c540ef0b-0264-4e80-92c0-65f5ad80fba7-kube-rbac-proxy-sar-config" pod "c540ef0b-0264-4e80-92c0-65f5ad80fba7" (UID: "c540ef0b-0264-4e80-92c0-65f5ad80fba7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:15:49.310795 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.310762 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c540ef0b-0264-4e80-92c0-65f5ad80fba7-kube-api-access-pqzmw" pod "c540ef0b-0264-4e80-92c0-65f5ad80fba7" (UID: "c540ef0b-0264-4e80-92c0-65f5ad80fba7"). InnerVolumeSpecName "kube-api-access-pqzmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:15:49.310898 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.310867 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c540ef0b-0264-4e80-92c0-65f5ad80fba7-proxy-tls" pod "c540ef0b-0264-4e80-92c0-65f5ad80fba7" (UID: "c540ef0b-0264-4e80-92c0-65f5ad80fba7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:15:49.410079 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.410054 5052 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqzmw\" (UniqueName: \"kubernetes.io/projected/c540ef0b-0264-4e80-92c0-65f5ad80fba7-kube-api-access-pqzmw\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:15:49.410079 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.410078 5052 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c540ef0b-0264-4e80-92c0-65f5ad80fba7-proxy-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:15:49.410214 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.410090 5052 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c540ef0b-0264-4e80-92c0-65f5ad80fba7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:15:49.415909 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.415884 5052 generic.go:356] "Generic (PLEG): container finished" podID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerID="e640bc97bb6a6e6579be46249568ccde24e92f07d90852efa6e0325b6c241fde" exitCode=0 Oct 30 22:15:49.415999 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.415923 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" Oct 30 22:15:49.415999 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.415962 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" event={"ID":"c540ef0b-0264-4e80-92c0-65f5ad80fba7","Type":"ContainerDied","Data":"e640bc97bb6a6e6579be46249568ccde24e92f07d90852efa6e0325b6c241fde"} Oct 30 22:15:49.416065 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.416020 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c" event={"ID":"c540ef0b-0264-4e80-92c0-65f5ad80fba7","Type":"ContainerDied","Data":"3730e70ed43af7e88c4f4035b2c86a7bb49dab110fc50a1d52c7d4e37000e7c2"} Oct 30 22:15:49.416065 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.416046 5052 scope.go:122] "RemoveContainer" containerID="86b373c4a5893709c4246b481c04ec7c30f4d14b20bd28b8df07cac90739103c" Oct 30 22:15:49.424607 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.424590 5052 scope.go:122] "RemoveContainer" containerID="e640bc97bb6a6e6579be46249568ccde24e92f07d90852efa6e0325b6c241fde" Oct 30 22:15:49.431966 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.431952 5052 scope.go:122] "RemoveContainer" containerID="86b373c4a5893709c4246b481c04ec7c30f4d14b20bd28b8df07cac90739103c" Oct 30 22:15:49.432207 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:15:49.432186 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86b373c4a5893709c4246b481c04ec7c30f4d14b20bd28b8df07cac90739103c\": container with ID starting with 86b373c4a5893709c4246b481c04ec7c30f4d14b20bd28b8df07cac90739103c not found: ID does not exist" containerID="86b373c4a5893709c4246b481c04ec7c30f4d14b20bd28b8df07cac90739103c" Oct 30 22:15:49.432265 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.432214 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b373c4a5893709c4246b481c04ec7c30f4d14b20bd28b8df07cac90739103c"} err="failed to get container status \"86b373c4a5893709c4246b481c04ec7c30f4d14b20bd28b8df07cac90739103c\": rpc error: code = NotFound desc = could not find container \"86b373c4a5893709c4246b481c04ec7c30f4d14b20bd28b8df07cac90739103c\": container with ID starting with 86b373c4a5893709c4246b481c04ec7c30f4d14b20bd28b8df07cac90739103c not found: ID does not exist" Oct 30 22:15:49.432265 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.432237 5052 scope.go:122] "RemoveContainer" containerID="e640bc97bb6a6e6579be46249568ccde24e92f07d90852efa6e0325b6c241fde" Oct 30 22:15:49.432499 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:15:49.432478 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e640bc97bb6a6e6579be46249568ccde24e92f07d90852efa6e0325b6c241fde\": container with ID starting with e640bc97bb6a6e6579be46249568ccde24e92f07d90852efa6e0325b6c241fde not found: ID does not exist" containerID="e640bc97bb6a6e6579be46249568ccde24e92f07d90852efa6e0325b6c241fde" Oct 30 22:15:49.432549 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.432507 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e640bc97bb6a6e6579be46249568ccde24e92f07d90852efa6e0325b6c241fde"} err="failed to get container status \"e640bc97bb6a6e6579be46249568ccde24e92f07d90852efa6e0325b6c241fde\": rpc error: code = NotFound desc = could not find container \"e640bc97bb6a6e6579be46249568ccde24e92f07d90852efa6e0325b6c241fde\": container with ID starting with e640bc97bb6a6e6579be46249568ccde24e92f07d90852efa6e0325b6c241fde not found: ID does not exist" Oct 30 22:15:49.438033 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.438014 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c"] Oct 30 22:15:49.442285 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:49.442266 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-08888-predictor-dbb5fdc6-rp62c"] Oct 30 22:15:50.608293 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:50.608261 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" path="/var/lib/kubelet/pods/c540ef0b-0264-4e80-92c0-65f5ad80fba7/volumes" Oct 30 22:15:51.202127 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.202091 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt"] Oct 30 22:15:51.202461 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.202448 5052 cpu_manager.go:414] "containerMap: removing container" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kube-rbac-proxy" Oct 30 22:15:51.202505 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.202464 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kube-rbac-proxy" Oct 30 22:15:51.202505 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.202485 5052 cpu_manager.go:414] "containerMap: removing container" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kserve-container" Oct 30 22:15:51.202505 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.202490 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kserve-container" Oct 30 22:15:51.202601 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.202570 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kserve-container" Oct 30 22:15:51.202601 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.202583 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="c540ef0b-0264-4e80-92c0-65f5ad80fba7" containerName="kube-rbac-proxy" Oct 30 22:15:51.207039 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.207012 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:15:51.208337 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.208308 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:51.215676 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.215653 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"success-200-isvc-a2e00-kube-rbac-proxy-sar-config\"" Oct 30 22:15:51.215821 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.215672 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"kube-root-ca.crt\"" Oct 30 22:15:51.216764 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.216740 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"success-200-isvc-a2e00-predictor-serving-cert\"" Oct 30 22:15:51.217220 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.217201 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt"] Oct 30 22:15:51.279051 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.279022 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused" Oct 30 22:15:51.314280 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.314248 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:51.325822 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.325801 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/993ebe4d-a20a-43da-8a6e-dbeae470ff74-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt\" (UID: \"993ebe4d-a20a-43da-8a6e-dbeae470ff74\") " pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:15:51.325924 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.325834 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-597bz\" (UniqueName: \"kubernetes.io/projected/993ebe4d-a20a-43da-8a6e-dbeae470ff74-kube-api-access-597bz\") pod \"success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt\" (UID: \"993ebe4d-a20a-43da-8a6e-dbeae470ff74\") " pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:15:51.325970 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.325922 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/993ebe4d-a20a-43da-8a6e-dbeae470ff74-proxy-tls\") pod \"success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt\" (UID: \"993ebe4d-a20a-43da-8a6e-dbeae470ff74\") " pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:15:51.424062 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.424022 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:51.427222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.427199 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/993ebe4d-a20a-43da-8a6e-dbeae470ff74-proxy-tls\") pod \"success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt\" (UID: \"993ebe4d-a20a-43da-8a6e-dbeae470ff74\") " pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:15:51.427357 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.427265 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/993ebe4d-a20a-43da-8a6e-dbeae470ff74-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt\" (UID: \"993ebe4d-a20a-43da-8a6e-dbeae470ff74\") " pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:15:51.427357 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.427290 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-597bz\" (UniqueName: \"kubernetes.io/projected/993ebe4d-a20a-43da-8a6e-dbeae470ff74-kube-api-access-597bz\") pod \"success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt\" (UID: \"993ebe4d-a20a-43da-8a6e-dbeae470ff74\") " pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:15:51.428009 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.427985 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/993ebe4d-a20a-43da-8a6e-dbeae470ff74-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt\" (UID: \"993ebe4d-a20a-43da-8a6e-dbeae470ff74\") " pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:15:51.429651 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.429624 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/993ebe4d-a20a-43da-8a6e-dbeae470ff74-proxy-tls\") pod \"success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt\" (UID: \"993ebe4d-a20a-43da-8a6e-dbeae470ff74\") " pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:15:51.440684 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.440658 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-597bz\" (UniqueName: \"kubernetes.io/projected/993ebe4d-a20a-43da-8a6e-dbeae470ff74-kube-api-access-597bz\") pod \"success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt\" (UID: \"993ebe4d-a20a-43da-8a6e-dbeae470ff74\") " pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:15:51.523358 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.523333 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:15:51.529272 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.529241 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:51.797814 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:51.797755 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt"] Oct 30 22:15:51.800479 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:15:51.800442 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod993ebe4d_a20a_43da_8a6e_dbeae470ff74.slice/crio-e87d69bffdc6496b7ef49aa4398766cee43bb79c12ffced3549a826f13075eb1 WatchSource:0}: Error finding container e87d69bffdc6496b7ef49aa4398766cee43bb79c12ffced3549a826f13075eb1: Status 404 returned error can't find the container with id e87d69bffdc6496b7ef49aa4398766cee43bb79c12ffced3549a826f13075eb1 Oct 30 22:15:52.432680 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:52.432646 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" event={"ID":"993ebe4d-a20a-43da-8a6e-dbeae470ff74","Type":"ContainerStarted","Data":"bbf032a128ba2caad0950829c7a43afcfbae4b0df1b0f69711772b74b03a7b67"} Oct 30 22:15:52.432888 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:52.432712 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" event={"ID":"993ebe4d-a20a-43da-8a6e-dbeae470ff74","Type":"ContainerStarted","Data":"0df0d4a8713e3a69428c1441ba994d41bd1648ac5f9c4fef77fc5e47d4776b83"} Oct 30 22:15:52.432888 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:52.432741 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:15:52.432888 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:52.432759 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" event={"ID":"993ebe4d-a20a-43da-8a6e-dbeae470ff74","Type":"ContainerStarted","Data":"e87d69bffdc6496b7ef49aa4398766cee43bb79c12ffced3549a826f13075eb1"} Oct 30 22:15:52.453733 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:52.453689 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" podStartSLOduration=1.453676501 podStartE2EDuration="1.453676501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:52.453160618 +0000 UTC m=+1361.976201370" watchObservedRunningTime="2026-10-30 22:15:52.453676501 +0000 UTC m=+1361.976717228" Oct 30 22:15:53.436558 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:53.436528 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:15:53.438095 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:53.438068 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused" Oct 30 22:15:54.440586 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:54.440550 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused" Oct 30 22:15:59.444869 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:59.444828 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:15:59.445304 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:15:59.445277 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused" Oct 30 22:16:00.883917 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:00.883878 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:01.279522 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:01.279484 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused" Oct 30 22:16:04.986919 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:16:04.986881 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:16:09.446044 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:09.446003 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused" Oct 30 22:16:11.280062 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:11.280032 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:16:19.446065 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:19.446025 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused" Oct 30 22:16:23.337567 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:23.337534 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:23.439656 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:23.439620 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:25.308970 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:25.308932 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:29.445731 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:29.445690 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused" Oct 30 22:16:34.655841 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:34.655804 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w"] Oct 30 22:16:34.656336 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:34.656141 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kserve-container" containerID="cri-o://4af5898574a86f95238690e473876d829cabb6d7dc56c64377379fc5bca9e428" gracePeriod=30 Oct 30 22:16:34.656336 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:34.656145 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kube-rbac-proxy" containerID="cri-o://d0e13919252bc07b559a0a75e6f9c204e59e7a9efd1c4827b01b170dc423d87e" gracePeriod=30 Oct 30 22:16:34.681708 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:34.681678 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:34.784777 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:34.784746 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:34.990292 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:16:34.990257 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:16:35.617333 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:35.617299 5052 generic.go:356] "Generic (PLEG): container finished" podID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerID="d0e13919252bc07b559a0a75e6f9c204e59e7a9efd1c4827b01b170dc423d87e" exitCode=0 Oct 30 22:16:35.617333 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:35.617337 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" event={"ID":"0c9e6854-99a1-406d-b968-fe1d921a38b7","Type":"ContainerDied","Data":"d0e13919252bc07b559a0a75e6f9c204e59e7a9efd1c4827b01b170dc423d87e"} Oct 30 22:16:36.274246 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:36.274203 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.42:8643/healthz\": dial tcp 10.132.0.42:8643: connect: connection refused" Oct 30 22:16:38.498332 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.498296 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:16:38.617344 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.617315 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c9e6854-99a1-406d-b968-fe1d921a38b7-proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c9e6854-99a1-406d-b968-fe1d921a38b7-proxy-tls\") pod \"0c9e6854-99a1-406d-b968-fe1d921a38b7\" (UID: \"0c9e6854-99a1-406d-b968-fe1d921a38b7\") " Oct 30 22:16:38.617501 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.617352 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c9e6854-99a1-406d-b968-fe1d921a38b7-kube-api-access-v4rgt\" (UniqueName: \"kubernetes.io/projected/0c9e6854-99a1-406d-b968-fe1d921a38b7-kube-api-access-v4rgt\") pod \"0c9e6854-99a1-406d-b968-fe1d921a38b7\" (UID: \"0c9e6854-99a1-406d-b968-fe1d921a38b7\") " Oct 30 22:16:38.617501 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.617449 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0c9e6854-99a1-406d-b968-fe1d921a38b7-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0c9e6854-99a1-406d-b968-fe1d921a38b7-kube-rbac-proxy-sar-config\") pod \"0c9e6854-99a1-406d-b968-fe1d921a38b7\" (UID: \"0c9e6854-99a1-406d-b968-fe1d921a38b7\") " Oct 30 22:16:38.617837 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.617816 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c9e6854-99a1-406d-b968-fe1d921a38b7-kube-rbac-proxy-sar-config" pod "0c9e6854-99a1-406d-b968-fe1d921a38b7" (UID: "0c9e6854-99a1-406d-b968-fe1d921a38b7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:16:38.619435 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.619388 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c9e6854-99a1-406d-b968-fe1d921a38b7-kube-api-access-v4rgt" pod "0c9e6854-99a1-406d-b968-fe1d921a38b7" (UID: "0c9e6854-99a1-406d-b968-fe1d921a38b7"). InnerVolumeSpecName "kube-api-access-v4rgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:16:38.619549 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.619524 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c9e6854-99a1-406d-b968-fe1d921a38b7-proxy-tls" pod "0c9e6854-99a1-406d-b968-fe1d921a38b7" (UID: "0c9e6854-99a1-406d-b968-fe1d921a38b7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:16:38.632797 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.632762 5052 generic.go:356] "Generic (PLEG): container finished" podID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerID="4af5898574a86f95238690e473876d829cabb6d7dc56c64377379fc5bca9e428" exitCode=0 Oct 30 22:16:38.632943 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.632815 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" Oct 30 22:16:38.632943 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.632843 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" event={"ID":"0c9e6854-99a1-406d-b968-fe1d921a38b7","Type":"ContainerDied","Data":"4af5898574a86f95238690e473876d829cabb6d7dc56c64377379fc5bca9e428"} Oct 30 22:16:38.632943 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.632922 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w" event={"ID":"0c9e6854-99a1-406d-b968-fe1d921a38b7","Type":"ContainerDied","Data":"88e6e0c8790aea3fcb2f0b9c4b7af6356263fcd75ac08a57c1ed4178df230971"} Oct 30 22:16:38.633076 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.632951 5052 scope.go:122] "RemoveContainer" containerID="d0e13919252bc07b559a0a75e6f9c204e59e7a9efd1c4827b01b170dc423d87e" Oct 30 22:16:38.641454 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.641438 5052 scope.go:122] "RemoveContainer" containerID="4af5898574a86f95238690e473876d829cabb6d7dc56c64377379fc5bca9e428" Oct 30 22:16:38.648915 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.648898 5052 scope.go:122] "RemoveContainer" containerID="d0e13919252bc07b559a0a75e6f9c204e59e7a9efd1c4827b01b170dc423d87e" Oct 30 22:16:38.649180 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:16:38.649160 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0e13919252bc07b559a0a75e6f9c204e59e7a9efd1c4827b01b170dc423d87e\": container with ID starting with d0e13919252bc07b559a0a75e6f9c204e59e7a9efd1c4827b01b170dc423d87e not found: ID does not exist" containerID="d0e13919252bc07b559a0a75e6f9c204e59e7a9efd1c4827b01b170dc423d87e" Oct 30 22:16:38.649232 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.649190 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e13919252bc07b559a0a75e6f9c204e59e7a9efd1c4827b01b170dc423d87e"} err="failed to get container status \"d0e13919252bc07b559a0a75e6f9c204e59e7a9efd1c4827b01b170dc423d87e\": rpc error: code = NotFound desc = could not find container \"d0e13919252bc07b559a0a75e6f9c204e59e7a9efd1c4827b01b170dc423d87e\": container with ID starting with d0e13919252bc07b559a0a75e6f9c204e59e7a9efd1c4827b01b170dc423d87e not found: ID does not exist" Oct 30 22:16:38.649232 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.649205 5052 scope.go:122] "RemoveContainer" containerID="4af5898574a86f95238690e473876d829cabb6d7dc56c64377379fc5bca9e428" Oct 30 22:16:38.649449 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:16:38.649434 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4af5898574a86f95238690e473876d829cabb6d7dc56c64377379fc5bca9e428\": container with ID starting with 4af5898574a86f95238690e473876d829cabb6d7dc56c64377379fc5bca9e428 not found: ID does not exist" containerID="4af5898574a86f95238690e473876d829cabb6d7dc56c64377379fc5bca9e428" Oct 30 22:16:38.649485 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.649456 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af5898574a86f95238690e473876d829cabb6d7dc56c64377379fc5bca9e428"} err="failed to get container status \"4af5898574a86f95238690e473876d829cabb6d7dc56c64377379fc5bca9e428\": rpc error: code = NotFound desc = could not find container \"4af5898574a86f95238690e473876d829cabb6d7dc56c64377379fc5bca9e428\": container with ID starting with 4af5898574a86f95238690e473876d829cabb6d7dc56c64377379fc5bca9e428 not found: ID does not exist" Oct 30 22:16:38.654747 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.654726 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w"] Oct 30 22:16:38.659252 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.659230 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-47126-predictor-77fcdcc8cb-zwn9w"] Oct 30 22:16:38.719028 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.718995 5052 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0c9e6854-99a1-406d-b968-fe1d921a38b7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:16:38.719028 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.719021 5052 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c9e6854-99a1-406d-b968-fe1d921a38b7-proxy-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:16:38.719028 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:38.719032 5052 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4rgt\" (UniqueName: \"kubernetes.io/projected/0c9e6854-99a1-406d-b968-fe1d921a38b7-kube-api-access-v4rgt\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:16:39.450062 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:39.445292 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused" Oct 30 22:16:40.019974 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.019942 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4"] Oct 30 22:16:40.020356 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.020319 5052 cpu_manager.go:414] "containerMap: removing container" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kube-rbac-proxy" Oct 30 22:16:40.020356 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.020330 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kube-rbac-proxy" Oct 30 22:16:40.020356 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.020343 5052 cpu_manager.go:414] "containerMap: removing container" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kserve-container" Oct 30 22:16:40.020356 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.020348 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kserve-container" Oct 30 22:16:40.020475 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.020426 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kube-rbac-proxy" Oct 30 22:16:40.020475 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.020436 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" containerName="kserve-container" Oct 30 22:16:40.024658 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.024639 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:16:40.033484 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.033459 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"success-200-isvc-32399-kube-rbac-proxy-sar-config\"" Oct 30 22:16:40.038627 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.038607 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"kube-root-ca.crt\"" Oct 30 22:16:40.039764 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.039739 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"success-200-isvc-32399-predictor-serving-cert\"" Oct 30 22:16:40.041193 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.041163 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4"] Oct 30 22:16:40.130470 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.130431 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b5f671c8-05fd-4512-b403-96ba0ddca2e4-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-32399-predictor-8666d8d676-jwpv4\" (UID: \"b5f671c8-05fd-4512-b403-96ba0ddca2e4\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:16:40.130657 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.130479 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b5f671c8-05fd-4512-b403-96ba0ddca2e4-proxy-tls\") pod \"success-200-isvc-32399-predictor-8666d8d676-jwpv4\" (UID: \"b5f671c8-05fd-4512-b403-96ba0ddca2e4\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:16:40.130657 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.130506 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpzxs\" (UniqueName: \"kubernetes.io/projected/b5f671c8-05fd-4512-b403-96ba0ddca2e4-kube-api-access-fpzxs\") pod \"success-200-isvc-32399-predictor-8666d8d676-jwpv4\" (UID: \"b5f671c8-05fd-4512-b403-96ba0ddca2e4\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:16:40.231245 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.231210 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b5f671c8-05fd-4512-b403-96ba0ddca2e4-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-32399-predictor-8666d8d676-jwpv4\" (UID: \"b5f671c8-05fd-4512-b403-96ba0ddca2e4\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:16:40.231245 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.231250 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b5f671c8-05fd-4512-b403-96ba0ddca2e4-proxy-tls\") pod \"success-200-isvc-32399-predictor-8666d8d676-jwpv4\" (UID: \"b5f671c8-05fd-4512-b403-96ba0ddca2e4\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:16:40.231469 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.231268 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpzxs\" (UniqueName: \"kubernetes.io/projected/b5f671c8-05fd-4512-b403-96ba0ddca2e4-kube-api-access-fpzxs\") pod \"success-200-isvc-32399-predictor-8666d8d676-jwpv4\" (UID: \"b5f671c8-05fd-4512-b403-96ba0ddca2e4\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:16:40.232040 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.232017 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b5f671c8-05fd-4512-b403-96ba0ddca2e4-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-32399-predictor-8666d8d676-jwpv4\" (UID: \"b5f671c8-05fd-4512-b403-96ba0ddca2e4\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:16:40.233660 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.233637 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b5f671c8-05fd-4512-b403-96ba0ddca2e4-proxy-tls\") pod \"success-200-isvc-32399-predictor-8666d8d676-jwpv4\" (UID: \"b5f671c8-05fd-4512-b403-96ba0ddca2e4\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:16:40.246276 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.246247 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpzxs\" (UniqueName: \"kubernetes.io/projected/b5f671c8-05fd-4512-b403-96ba0ddca2e4-kube-api-access-fpzxs\") pod \"success-200-isvc-32399-predictor-8666d8d676-jwpv4\" (UID: \"b5f671c8-05fd-4512-b403-96ba0ddca2e4\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:16:40.338880 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.338773 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:16:40.607681 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.607607 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0c9e6854-99a1-406d-b968-fe1d921a38b7" path="/var/lib/kubelet/pods/0c9e6854-99a1-406d-b968-fe1d921a38b7/volumes" Oct 30 22:16:40.615842 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.615813 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4"] Oct 30 22:16:40.619460 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:16:40.619435 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f671c8_05fd_4512_b403_96ba0ddca2e4.slice/crio-2d30271cd403753721c1572d894035e1213b687c7c4cea2ec0e966a379ce4334 WatchSource:0}: Error finding container 2d30271cd403753721c1572d894035e1213b687c7c4cea2ec0e966a379ce4334: Status 404 returned error can't find the container with id 2d30271cd403753721c1572d894035e1213b687c7c4cea2ec0e966a379ce4334 Oct 30 22:16:40.642814 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.642781 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" event={"ID":"b5f671c8-05fd-4512-b403-96ba0ddca2e4","Type":"ContainerStarted","Data":"2d30271cd403753721c1572d894035e1213b687c7c4cea2ec0e966a379ce4334"} Oct 30 22:16:40.999665 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:40.999630 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:41.298917 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:41.298826 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:41.648713 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:41.648627 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" event={"ID":"b5f671c8-05fd-4512-b403-96ba0ddca2e4","Type":"ContainerStarted","Data":"b9e35782ba443acef4aa9369351b9948cd2d445a1802c472afd6c46d93479428"} Oct 30 22:16:41.648713 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:41.648686 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" event={"ID":"b5f671c8-05fd-4512-b403-96ba0ddca2e4","Type":"ContainerStarted","Data":"44466a03605ab1b7dfcfc65f85fff4599b275d378fa04c8b05f10db3f1903513"} Oct 30 22:16:41.648952 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:41.648813 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:16:41.648952 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:41.648884 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:16:41.650002 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:41.649975 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused" Oct 30 22:16:41.671913 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:41.671835 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" podStartSLOduration=2.671824049 podStartE2EDuration="2.671824049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:41.670639879 +0000 UTC m=+1411.193680632" watchObservedRunningTime="2026-10-30 22:16:41.671824049 +0000 UTC m=+1411.194864782" Oct 30 22:16:42.653194 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:42.653157 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused" Oct 30 22:16:47.658282 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:47.658250 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:16:47.658775 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:47.658747 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused" Oct 30 22:16:49.446001 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:49.445966 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:16:57.659235 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:16:57.659194 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused" Oct 30 22:17:00.950327 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:17:00.950274 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:17:01.436561 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:17:01.436519 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:17:01.538821 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:17:01.538783 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:17:04.986578 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:17:04.986547 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:17:07.659659 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:17:07.659613 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused" Oct 30 22:17:17.659159 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:17:17.659115 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused" Oct 30 22:17:27.659686 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:17:27.659646 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused" Oct 30 22:17:34.986352 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:17:34.986316 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:17:37.659464 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:17:37.659436 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:17:50.284685 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:17:50.284644 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:17:50.390595 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:17:50.390549 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:00.994482 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:18:00.994444 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:04.987667 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:18:04.987633 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:18:10.745731 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:18:10.745700 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:18:10.749481 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:18:10.749460 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:18:34.986782 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:18:34.986743 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:19:01.057689 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:19:01.057652 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:19:04.985473 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:19:04.985437 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:19:34.986246 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:19:34.986209 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:19:51.762374 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:19:51.762327 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:20:01.091528 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:20:01.091489 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:20:04.987037 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:20:04.986997 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:20:34.624566 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:20:34.624528 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:20:34.725639 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:20:34.725607 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:20:34.986666 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:20:34.986636 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:21:01.156374 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:21:01.156290 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:04.986708 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:21:04.986663 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:21:34.986651 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:21:34.986613 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:22:01.219319 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:22:01.219280 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:22:04.986551 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:22:04.986518 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:22:34.985754 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:22:34.985718 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:23:01.262438 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:23:01.262402 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:04.986146 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:23:04.986114 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:23:10.774460 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:23:10.774428 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:23:10.777683 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:23:10.777660 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:23:34.985740 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:23:34.985704 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:23:58.841038 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:23:58.840955 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:24:01.321775 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:24:01.321736 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:24:04.985870 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:24:04.985817 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:24:34.986591 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:24:34.986549 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:25:01.374407 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:01.374364 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:04.986653 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:25:04.986621 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:25:17.153251 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:17.153203 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:17.175330 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:17.175299 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt"] Oct 30 22:25:17.175547 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:17.175522 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kserve-container" containerID="cri-o://0df0d4a8713e3a69428c1441ba994d41bd1648ac5f9c4fef77fc5e47d4776b83" gracePeriod=30 Oct 30 22:25:17.175684 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:17.175635 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kube-rbac-proxy" containerID="cri-o://bbf032a128ba2caad0950829c7a43afcfbae4b0df1b0f69711772b74b03a7b67" gracePeriod=30 Oct 30 22:25:17.302209 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:17.302180 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:17.837154 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:17.837119 5052 generic.go:356] "Generic (PLEG): container finished" podID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerID="bbf032a128ba2caad0950829c7a43afcfbae4b0df1b0f69711772b74b03a7b67" exitCode=0 Oct 30 22:25:17.837324 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:17.837161 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" event={"ID":"993ebe4d-a20a-43da-8a6e-dbeae470ff74","Type":"ContainerDied","Data":"bbf032a128ba2caad0950829c7a43afcfbae4b0df1b0f69711772b74b03a7b67"} Oct 30 22:25:19.441474 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:19.441434 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.43:8643/healthz\": dial tcp 10.132.0.43:8643: connect: connection refused" Oct 30 22:25:19.445790 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:19.445763 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused" Oct 30 22:25:20.429314 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.429285 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:25:20.560238 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.560170 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/993ebe4d-a20a-43da-8a6e-dbeae470ff74-kube-api-access-597bz\" (UniqueName: \"kubernetes.io/projected/993ebe4d-a20a-43da-8a6e-dbeae470ff74-kube-api-access-597bz\") pod \"993ebe4d-a20a-43da-8a6e-dbeae470ff74\" (UID: \"993ebe4d-a20a-43da-8a6e-dbeae470ff74\") " Oct 30 22:25:20.560238 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.560213 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/993ebe4d-a20a-43da-8a6e-dbeae470ff74-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/993ebe4d-a20a-43da-8a6e-dbeae470ff74-kube-rbac-proxy-sar-config\") pod \"993ebe4d-a20a-43da-8a6e-dbeae470ff74\" (UID: \"993ebe4d-a20a-43da-8a6e-dbeae470ff74\") " Oct 30 22:25:20.560636 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.560264 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/993ebe4d-a20a-43da-8a6e-dbeae470ff74-proxy-tls\" (UniqueName: \"kubernetes.io/secret/993ebe4d-a20a-43da-8a6e-dbeae470ff74-proxy-tls\") pod \"993ebe4d-a20a-43da-8a6e-dbeae470ff74\" (UID: \"993ebe4d-a20a-43da-8a6e-dbeae470ff74\") " Oct 30 22:25:20.560636 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.560567 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/993ebe4d-a20a-43da-8a6e-dbeae470ff74-kube-rbac-proxy-sar-config" pod "993ebe4d-a20a-43da-8a6e-dbeae470ff74" (UID: "993ebe4d-a20a-43da-8a6e-dbeae470ff74"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:25:20.562413 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.562382 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/993ebe4d-a20a-43da-8a6e-dbeae470ff74-proxy-tls" pod "993ebe4d-a20a-43da-8a6e-dbeae470ff74" (UID: "993ebe4d-a20a-43da-8a6e-dbeae470ff74"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:25:20.562413 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.562390 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/993ebe4d-a20a-43da-8a6e-dbeae470ff74-kube-api-access-597bz" pod "993ebe4d-a20a-43da-8a6e-dbeae470ff74" (UID: "993ebe4d-a20a-43da-8a6e-dbeae470ff74"). InnerVolumeSpecName "kube-api-access-597bz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:25:20.661639 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.661610 5052 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/993ebe4d-a20a-43da-8a6e-dbeae470ff74-proxy-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:25:20.661639 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.661637 5052 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-597bz\" (UniqueName: \"kubernetes.io/projected/993ebe4d-a20a-43da-8a6e-dbeae470ff74-kube-api-access-597bz\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:25:20.661784 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.661647 5052 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/993ebe4d-a20a-43da-8a6e-dbeae470ff74-kube-rbac-proxy-sar-config\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:25:20.852083 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.852009 5052 generic.go:356] "Generic (PLEG): container finished" podID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerID="0df0d4a8713e3a69428c1441ba994d41bd1648ac5f9c4fef77fc5e47d4776b83" exitCode=0 Oct 30 22:25:20.852083 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.852070 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" Oct 30 22:25:20.852268 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.852100 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" event={"ID":"993ebe4d-a20a-43da-8a6e-dbeae470ff74","Type":"ContainerDied","Data":"0df0d4a8713e3a69428c1441ba994d41bd1648ac5f9c4fef77fc5e47d4776b83"} Oct 30 22:25:20.852268 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.852182 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt" event={"ID":"993ebe4d-a20a-43da-8a6e-dbeae470ff74","Type":"ContainerDied","Data":"e87d69bffdc6496b7ef49aa4398766cee43bb79c12ffced3549a826f13075eb1"} Oct 30 22:25:20.852268 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.852219 5052 scope.go:122] "RemoveContainer" containerID="bbf032a128ba2caad0950829c7a43afcfbae4b0df1b0f69711772b74b03a7b67" Oct 30 22:25:20.864690 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.864662 5052 scope.go:122] "RemoveContainer" containerID="0df0d4a8713e3a69428c1441ba994d41bd1648ac5f9c4fef77fc5e47d4776b83" Oct 30 22:25:20.869719 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.869693 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt"] Oct 30 22:25:20.873592 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.873572 5052 scope.go:122] "RemoveContainer" containerID="bbf032a128ba2caad0950829c7a43afcfbae4b0df1b0f69711772b74b03a7b67" Oct 30 22:25:20.873847 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:25:20.873827 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbf032a128ba2caad0950829c7a43afcfbae4b0df1b0f69711772b74b03a7b67\": container with ID starting with bbf032a128ba2caad0950829c7a43afcfbae4b0df1b0f69711772b74b03a7b67 not found: ID does not exist" containerID="bbf032a128ba2caad0950829c7a43afcfbae4b0df1b0f69711772b74b03a7b67" Oct 30 22:25:20.873962 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.873937 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbf032a128ba2caad0950829c7a43afcfbae4b0df1b0f69711772b74b03a7b67"} err="failed to get container status \"bbf032a128ba2caad0950829c7a43afcfbae4b0df1b0f69711772b74b03a7b67\": rpc error: code = NotFound desc = could not find container \"bbf032a128ba2caad0950829c7a43afcfbae4b0df1b0f69711772b74b03a7b67\": container with ID starting with bbf032a128ba2caad0950829c7a43afcfbae4b0df1b0f69711772b74b03a7b67 not found: ID does not exist" Oct 30 22:25:20.874007 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.873964 5052 scope.go:122] "RemoveContainer" containerID="0df0d4a8713e3a69428c1441ba994d41bd1648ac5f9c4fef77fc5e47d4776b83" Oct 30 22:25:20.874096 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.874079 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-a2e00-predictor-dcd8cd6cb-xkbpt"] Oct 30 22:25:20.874187 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:25:20.874170 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0df0d4a8713e3a69428c1441ba994d41bd1648ac5f9c4fef77fc5e47d4776b83\": container with ID starting with 0df0d4a8713e3a69428c1441ba994d41bd1648ac5f9c4fef77fc5e47d4776b83 not found: ID does not exist" containerID="0df0d4a8713e3a69428c1441ba994d41bd1648ac5f9c4fef77fc5e47d4776b83" Oct 30 22:25:20.874230 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:20.874191 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0df0d4a8713e3a69428c1441ba994d41bd1648ac5f9c4fef77fc5e47d4776b83"} err="failed to get container status \"0df0d4a8713e3a69428c1441ba994d41bd1648ac5f9c4fef77fc5e47d4776b83\": rpc error: code = NotFound desc = could not find container \"0df0d4a8713e3a69428c1441ba994d41bd1648ac5f9c4fef77fc5e47d4776b83\": container with ID starting with 0df0d4a8713e3a69428c1441ba994d41bd1648ac5f9c4fef77fc5e47d4776b83 not found: ID does not exist" Oct 30 22:25:22.371248 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.371214 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:22.411731 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.411708 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc"] Oct 30 22:25:22.412061 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.412049 5052 cpu_manager.go:414] "containerMap: removing container" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kube-rbac-proxy" Oct 30 22:25:22.412108 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.412063 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kube-rbac-proxy" Oct 30 22:25:22.412108 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.412088 5052 cpu_manager.go:414] "containerMap: removing container" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kserve-container" Oct 30 22:25:22.412108 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.412093 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kserve-container" Oct 30 22:25:22.412196 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.412185 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kube-rbac-proxy" Oct 30 22:25:22.412238 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.412199 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" containerName="kserve-container" Oct 30 22:25:22.416391 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.416374 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:25:22.424717 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.424696 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"success-200-isvc-b14c2-predictor-serving-cert\"" Oct 30 22:25:22.426900 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.426853 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc"] Oct 30 22:25:22.427016 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.426992 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"kube-root-ca.crt\"" Oct 30 22:25:22.427132 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.426939 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"success-200-isvc-b14c2-kube-rbac-proxy-sar-config\"" Oct 30 22:25:22.485098 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.485066 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:22.577124 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.577089 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zrfj\" (UniqueName: \"kubernetes.io/projected/3609cbe2-0e7e-4878-ba74-4ad6413026d2-kube-api-access-2zrfj\") pod \"success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc\" (UID: \"3609cbe2-0e7e-4878-ba74-4ad6413026d2\") " pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:25:22.577280 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.577133 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3609cbe2-0e7e-4878-ba74-4ad6413026d2-proxy-tls\") pod \"success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc\" (UID: \"3609cbe2-0e7e-4878-ba74-4ad6413026d2\") " pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:25:22.577280 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.577268 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3609cbe2-0e7e-4878-ba74-4ad6413026d2-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc\" (UID: \"3609cbe2-0e7e-4878-ba74-4ad6413026d2\") " pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:25:22.591473 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.591443 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:22.608195 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.608167 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="993ebe4d-a20a-43da-8a6e-dbeae470ff74" path="/var/lib/kubelet/pods/993ebe4d-a20a-43da-8a6e-dbeae470ff74/volumes" Oct 30 22:25:22.678132 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.678073 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zrfj\" (UniqueName: \"kubernetes.io/projected/3609cbe2-0e7e-4878-ba74-4ad6413026d2-kube-api-access-2zrfj\") pod \"success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc\" (UID: \"3609cbe2-0e7e-4878-ba74-4ad6413026d2\") " pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:25:22.678132 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.678104 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3609cbe2-0e7e-4878-ba74-4ad6413026d2-proxy-tls\") pod \"success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc\" (UID: \"3609cbe2-0e7e-4878-ba74-4ad6413026d2\") " pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:25:22.678304 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.678142 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3609cbe2-0e7e-4878-ba74-4ad6413026d2-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc\" (UID: \"3609cbe2-0e7e-4878-ba74-4ad6413026d2\") " pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:25:22.678787 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.678764 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3609cbe2-0e7e-4878-ba74-4ad6413026d2-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc\" (UID: \"3609cbe2-0e7e-4878-ba74-4ad6413026d2\") " pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:25:22.680411 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.680389 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3609cbe2-0e7e-4878-ba74-4ad6413026d2-proxy-tls\") pod \"success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc\" (UID: \"3609cbe2-0e7e-4878-ba74-4ad6413026d2\") " pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:25:22.690133 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.690082 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zrfj\" (UniqueName: \"kubernetes.io/projected/3609cbe2-0e7e-4878-ba74-4ad6413026d2-kube-api-access-2zrfj\") pod \"success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc\" (UID: \"3609cbe2-0e7e-4878-ba74-4ad6413026d2\") " pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:25:22.701915 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.701892 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:22.732850 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:22.732821 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:25:23.006722 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:23.006695 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc"] Oct 30 22:25:23.011137 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:25:23.011105 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3609cbe2_0e7e_4878_ba74_4ad6413026d2.slice/crio-f96543e9f3ff009239e6ef5be9d852b102e7a3fa102ecfc31feeda7e504fd83f WatchSource:0}: Error finding container f96543e9f3ff009239e6ef5be9d852b102e7a3fa102ecfc31feeda7e504fd83f: Status 404 returned error can't find the container with id f96543e9f3ff009239e6ef5be9d852b102e7a3fa102ecfc31feeda7e504fd83f Oct 30 22:25:23.867403 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:23.867367 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" event={"ID":"3609cbe2-0e7e-4878-ba74-4ad6413026d2","Type":"ContainerStarted","Data":"eafb24a0aaefe1adc9071631773ce15d20110a92f87cf43c3660a3b0c23b3e82"} Oct 30 22:25:23.867887 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:23.867434 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" event={"ID":"3609cbe2-0e7e-4878-ba74-4ad6413026d2","Type":"ContainerStarted","Data":"2a7f1e30b4b4f4abed23c37cb5ed34aeb1abe91c66a4a1c3659462130af0a08c"} Oct 30 22:25:23.867887 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:23.867466 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" event={"ID":"3609cbe2-0e7e-4878-ba74-4ad6413026d2","Type":"ContainerStarted","Data":"f96543e9f3ff009239e6ef5be9d852b102e7a3fa102ecfc31feeda7e504fd83f"} Oct 30 22:25:23.867887 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:23.867517 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:25:23.888373 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:23.888333 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" podStartSLOduration=1.8883210049999999 podStartE2EDuration="1.888321005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:25:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:25:23.887355831 +0000 UTC m=+1933.410396586" watchObservedRunningTime="2026-10-30 22:25:23.888321005 +0000 UTC m=+1933.411361732" Oct 30 22:25:24.871425 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:24.871394 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:25:24.872565 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:24.872538 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.45:8080: connect: connection refused" Oct 30 22:25:25.875927 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:25.875887 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.45:8080: connect: connection refused" Oct 30 22:25:30.880679 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:30.880651 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:25:30.881108 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:30.881034 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.45:8080: connect: connection refused" Oct 30 22:25:34.986681 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:25:34.986646 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:25:40.881290 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:40.881255 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.45:8080: connect: connection refused" Oct 30 22:25:50.881751 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:25:50.881713 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.45:8080: connect: connection refused" Oct 30 22:26:00.881096 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:00.881059 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.45:8080: connect: connection refused" Oct 30 22:26:01.432454 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:01.432419 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:04.985678 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:26:04.985641 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:26:05.641565 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:05.641532 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4"] Oct 30 22:26:05.641817 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:05.641794 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kserve-container" containerID="cri-o://44466a03605ab1b7dfcfc65f85fff4599b275d378fa04c8b05f10db3f1903513" gracePeriod=30 Oct 30 22:26:05.641932 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:05.641896 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kube-rbac-proxy" containerID="cri-o://b9e35782ba443acef4aa9369351b9948cd2d445a1802c472afd6c46d93479428" gracePeriod=30 Oct 30 22:26:05.666199 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:05.666170 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:05.772143 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:05.772116 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:06.052345 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:06.052314 5052 generic.go:356] "Generic (PLEG): container finished" podID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerID="b9e35782ba443acef4aa9369351b9948cd2d445a1802c472afd6c46d93479428" exitCode=0 Oct 30 22:26:06.052710 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:06.052380 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" event={"ID":"b5f671c8-05fd-4512-b403-96ba0ddca2e4","Type":"ContainerDied","Data":"b9e35782ba443acef4aa9369351b9948cd2d445a1802c472afd6c46d93479428"} Oct 30 22:26:07.653943 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:07.653896 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.44:8643/healthz\": dial tcp 10.132.0.44:8643: connect: connection refused" Oct 30 22:26:07.659237 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:07.659203 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused" Oct 30 22:26:08.788770 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:08.788749 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:26:08.830486 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:08.830418 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b5f671c8-05fd-4512-b403-96ba0ddca2e4-kube-api-access-fpzxs\" (UniqueName: \"kubernetes.io/projected/b5f671c8-05fd-4512-b403-96ba0ddca2e4-kube-api-access-fpzxs\") pod \"b5f671c8-05fd-4512-b403-96ba0ddca2e4\" (UID: \"b5f671c8-05fd-4512-b403-96ba0ddca2e4\") " Oct 30 22:26:08.830486 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:08.830456 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b5f671c8-05fd-4512-b403-96ba0ddca2e4-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b5f671c8-05fd-4512-b403-96ba0ddca2e4-kube-rbac-proxy-sar-config\") pod \"b5f671c8-05fd-4512-b403-96ba0ddca2e4\" (UID: \"b5f671c8-05fd-4512-b403-96ba0ddca2e4\") " Oct 30 22:26:08.830679 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:08.830517 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b5f671c8-05fd-4512-b403-96ba0ddca2e4-proxy-tls\" (UniqueName: \"kubernetes.io/secret/b5f671c8-05fd-4512-b403-96ba0ddca2e4-proxy-tls\") pod \"b5f671c8-05fd-4512-b403-96ba0ddca2e4\" (UID: \"b5f671c8-05fd-4512-b403-96ba0ddca2e4\") " Oct 30 22:26:08.830853 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:08.830830 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5f671c8-05fd-4512-b403-96ba0ddca2e4-kube-rbac-proxy-sar-config" pod "b5f671c8-05fd-4512-b403-96ba0ddca2e4" (UID: "b5f671c8-05fd-4512-b403-96ba0ddca2e4"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:26:08.832410 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:08.832383 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5f671c8-05fd-4512-b403-96ba0ddca2e4-kube-api-access-fpzxs" pod "b5f671c8-05fd-4512-b403-96ba0ddca2e4" (UID: "b5f671c8-05fd-4512-b403-96ba0ddca2e4"). InnerVolumeSpecName "kube-api-access-fpzxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:26:08.832514 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:08.832443 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5f671c8-05fd-4512-b403-96ba0ddca2e4-proxy-tls" pod "b5f671c8-05fd-4512-b403-96ba0ddca2e4" (UID: "b5f671c8-05fd-4512-b403-96ba0ddca2e4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:26:08.931004 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:08.930982 5052 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b5f671c8-05fd-4512-b403-96ba0ddca2e4-proxy-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:26:08.931004 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:08.931003 5052 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpzxs\" (UniqueName: \"kubernetes.io/projected/b5f671c8-05fd-4512-b403-96ba0ddca2e4-kube-api-access-fpzxs\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:26:08.931128 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:08.931014 5052 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b5f671c8-05fd-4512-b403-96ba0ddca2e4-kube-rbac-proxy-sar-config\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:26:09.068355 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:09.068311 5052 generic.go:356] "Generic (PLEG): container finished" podID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerID="44466a03605ab1b7dfcfc65f85fff4599b275d378fa04c8b05f10db3f1903513" exitCode=0 Oct 30 22:26:09.068355 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:09.068355 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" Oct 30 22:26:09.068568 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:09.068381 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" event={"ID":"b5f671c8-05fd-4512-b403-96ba0ddca2e4","Type":"ContainerDied","Data":"44466a03605ab1b7dfcfc65f85fff4599b275d378fa04c8b05f10db3f1903513"} Oct 30 22:26:09.068568 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:09.068443 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4" event={"ID":"b5f671c8-05fd-4512-b403-96ba0ddca2e4","Type":"ContainerDied","Data":"2d30271cd403753721c1572d894035e1213b687c7c4cea2ec0e966a379ce4334"} Oct 30 22:26:09.068568 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:09.068470 5052 scope.go:122] "RemoveContainer" containerID="b9e35782ba443acef4aa9369351b9948cd2d445a1802c472afd6c46d93479428" Oct 30 22:26:09.077573 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:09.077555 5052 scope.go:122] "RemoveContainer" containerID="44466a03605ab1b7dfcfc65f85fff4599b275d378fa04c8b05f10db3f1903513" Oct 30 22:26:09.085169 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:09.085151 5052 scope.go:122] "RemoveContainer" containerID="b9e35782ba443acef4aa9369351b9948cd2d445a1802c472afd6c46d93479428" Oct 30 22:26:09.085408 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:26:09.085388 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9e35782ba443acef4aa9369351b9948cd2d445a1802c472afd6c46d93479428\": container with ID starting with b9e35782ba443acef4aa9369351b9948cd2d445a1802c472afd6c46d93479428 not found: ID does not exist" containerID="b9e35782ba443acef4aa9369351b9948cd2d445a1802c472afd6c46d93479428" Oct 30 22:26:09.085490 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:09.085421 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9e35782ba443acef4aa9369351b9948cd2d445a1802c472afd6c46d93479428"} err="failed to get container status \"b9e35782ba443acef4aa9369351b9948cd2d445a1802c472afd6c46d93479428\": rpc error: code = NotFound desc = could not find container \"b9e35782ba443acef4aa9369351b9948cd2d445a1802c472afd6c46d93479428\": container with ID starting with b9e35782ba443acef4aa9369351b9948cd2d445a1802c472afd6c46d93479428 not found: ID does not exist" Oct 30 22:26:09.085490 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:09.085444 5052 scope.go:122] "RemoveContainer" containerID="44466a03605ab1b7dfcfc65f85fff4599b275d378fa04c8b05f10db3f1903513" Oct 30 22:26:09.085660 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:26:09.085642 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44466a03605ab1b7dfcfc65f85fff4599b275d378fa04c8b05f10db3f1903513\": container with ID starting with 44466a03605ab1b7dfcfc65f85fff4599b275d378fa04c8b05f10db3f1903513 not found: ID does not exist" containerID="44466a03605ab1b7dfcfc65f85fff4599b275d378fa04c8b05f10db3f1903513" Oct 30 22:26:09.085702 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:09.085666 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44466a03605ab1b7dfcfc65f85fff4599b275d378fa04c8b05f10db3f1903513"} err="failed to get container status \"44466a03605ab1b7dfcfc65f85fff4599b275d378fa04c8b05f10db3f1903513\": rpc error: code = NotFound desc = could not find container \"44466a03605ab1b7dfcfc65f85fff4599b275d378fa04c8b05f10db3f1903513\": container with ID starting with 44466a03605ab1b7dfcfc65f85fff4599b275d378fa04c8b05f10db3f1903513 not found: ID does not exist" Oct 30 22:26:09.090998 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:09.090979 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4"] Oct 30 22:26:09.097078 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:09.097047 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-32399-predictor-8666d8d676-jwpv4"] Oct 30 22:26:10.607579 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:10.607546 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" path="/var/lib/kubelet/pods/b5f671c8-05fd-4512-b403-96ba0ddca2e4/volumes" Oct 30 22:26:10.881971 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:10.881917 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:26:11.018157 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.018125 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g"] Oct 30 22:26:11.018516 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.018504 5052 cpu_manager.go:414] "containerMap: removing container" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kserve-container" Oct 30 22:26:11.018560 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.018518 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kserve-container" Oct 30 22:26:11.018560 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.018546 5052 cpu_manager.go:414] "containerMap: removing container" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kube-rbac-proxy" Oct 30 22:26:11.018560 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.018552 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kube-rbac-proxy" Oct 30 22:26:11.018668 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.018620 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kserve-container" Oct 30 22:26:11.018668 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.018633 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="b5f671c8-05fd-4512-b403-96ba0ddca2e4" containerName="kube-rbac-proxy" Oct 30 22:26:11.022891 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.022874 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:26:11.028888 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.028853 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"success-200-isvc-18df3-predictor-serving-cert\"" Oct 30 22:26:11.029564 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.029379 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"kube-root-ca.crt\"" Oct 30 22:26:11.029564 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.029380 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"success-200-isvc-18df3-kube-rbac-proxy-sar-config\"" Oct 30 22:26:11.037547 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.037526 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g"] Oct 30 22:26:11.046044 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.046020 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:11.149121 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.149057 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx7pq\" (UniqueName: \"kubernetes.io/projected/3c05206f-5658-462c-bf04-a34719028652-kube-api-access-hx7pq\") pod \"success-200-isvc-18df3-predictor-5d95b78944-cmx2g\" (UID: \"3c05206f-5658-462c-bf04-a34719028652\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:26:11.149230 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.149125 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3c05206f-5658-462c-bf04-a34719028652-proxy-tls\") pod \"success-200-isvc-18df3-predictor-5d95b78944-cmx2g\" (UID: \"3c05206f-5658-462c-bf04-a34719028652\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:26:11.149230 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.149166 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3c05206f-5658-462c-bf04-a34719028652-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-18df3-predictor-5d95b78944-cmx2g\" (UID: \"3c05206f-5658-462c-bf04-a34719028652\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:26:11.250080 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.250054 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3c05206f-5658-462c-bf04-a34719028652-proxy-tls\") pod \"success-200-isvc-18df3-predictor-5d95b78944-cmx2g\" (UID: \"3c05206f-5658-462c-bf04-a34719028652\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:26:11.250080 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.250083 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3c05206f-5658-462c-bf04-a34719028652-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-18df3-predictor-5d95b78944-cmx2g\" (UID: \"3c05206f-5658-462c-bf04-a34719028652\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:26:11.250266 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.250132 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx7pq\" (UniqueName: \"kubernetes.io/projected/3c05206f-5658-462c-bf04-a34719028652-kube-api-access-hx7pq\") pod \"success-200-isvc-18df3-predictor-5d95b78944-cmx2g\" (UID: \"3c05206f-5658-462c-bf04-a34719028652\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:26:11.250946 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.250916 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3c05206f-5658-462c-bf04-a34719028652-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-18df3-predictor-5d95b78944-cmx2g\" (UID: \"3c05206f-5658-462c-bf04-a34719028652\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:26:11.252752 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.252721 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3c05206f-5658-462c-bf04-a34719028652-proxy-tls\") pod \"success-200-isvc-18df3-predictor-5d95b78944-cmx2g\" (UID: \"3c05206f-5658-462c-bf04-a34719028652\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:26:11.258782 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.258754 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:11.262718 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.262697 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx7pq\" (UniqueName: \"kubernetes.io/projected/3c05206f-5658-462c-bf04-a34719028652-kube-api-access-hx7pq\") pod \"success-200-isvc-18df3-predictor-5d95b78944-cmx2g\" (UID: \"3c05206f-5658-462c-bf04-a34719028652\") " pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:26:11.337603 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.337581 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:26:11.378110 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.378078 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:11.615780 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:11.615749 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g"] Oct 30 22:26:12.083675 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:12.083640 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" event={"ID":"3c05206f-5658-462c-bf04-a34719028652","Type":"ContainerStarted","Data":"f75f2b0b59febe12a5d816031526a5c2d2424b69cdfdd4f0ba9ab3447b8f6521"} Oct 30 22:26:12.083887 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:12.083703 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:26:12.083887 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:12.083723 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" event={"ID":"3c05206f-5658-462c-bf04-a34719028652","Type":"ContainerStarted","Data":"80ecf8628b0013c982c1652d1a665bd85d3a613293949ef053d46d3bef725128"} Oct 30 22:26:12.083887 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:12.083741 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" event={"ID":"3c05206f-5658-462c-bf04-a34719028652","Type":"ContainerStarted","Data":"24d8f47041c028c6a31bb3bddb4b58293c62b53096b02ae8bf556fe662097250"} Oct 30 22:26:12.083887 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:12.083762 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:26:12.085290 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:12.085267 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused" Oct 30 22:26:12.104363 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:12.104317 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" podStartSLOduration=2.10430426 podStartE2EDuration="2.10430426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:26:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:26:12.10353185 +0000 UTC m=+1981.626572633" watchObservedRunningTime="2026-10-30 22:26:12.10430426 +0000 UTC m=+1981.627344993" Oct 30 22:26:13.087866 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:13.087813 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused" Oct 30 22:26:18.092873 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:18.092825 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:26:18.093357 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:18.093331 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused" Oct 30 22:26:22.568730 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:22.568698 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk"] Oct 30 22:26:22.572287 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:22.572269 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" Oct 30 22:26:22.581798 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:22.581776 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"splitter-graph-b14c2-serving-cert\"" Oct 30 22:26:22.581798 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:22.581777 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"splitter-graph-b14c2-kube-rbac-proxy-sar-config\"" Oct 30 22:26:22.583098 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:22.583076 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk"] Oct 30 22:26:22.606579 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:22.606540 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:22.645153 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:22.645127 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30caa0e5-5eba-4fb8-98e7-c99e892a20c7-openshift-service-ca-bundle\") pod \"splitter-graph-b14c2-774b7488b-2krsk\" (UID: \"30caa0e5-5eba-4fb8-98e7-c99e892a20c7\") " pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" Oct 30 22:26:22.645260 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:22.645184 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30caa0e5-5eba-4fb8-98e7-c99e892a20c7-proxy-tls\") pod \"splitter-graph-b14c2-774b7488b-2krsk\" (UID: \"30caa0e5-5eba-4fb8-98e7-c99e892a20c7\") " pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" Oct 30 22:26:22.714670 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:22.714636 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:22.746209 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:22.746183 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30caa0e5-5eba-4fb8-98e7-c99e892a20c7-openshift-service-ca-bundle\") pod \"splitter-graph-b14c2-774b7488b-2krsk\" (UID: \"30caa0e5-5eba-4fb8-98e7-c99e892a20c7\") " pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" Oct 30 22:26:22.746324 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:22.746235 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30caa0e5-5eba-4fb8-98e7-c99e892a20c7-proxy-tls\") pod \"splitter-graph-b14c2-774b7488b-2krsk\" (UID: \"30caa0e5-5eba-4fb8-98e7-c99e892a20c7\") " pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" Oct 30 22:26:22.746779 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:22.746758 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30caa0e5-5eba-4fb8-98e7-c99e892a20c7-openshift-service-ca-bundle\") pod \"splitter-graph-b14c2-774b7488b-2krsk\" (UID: \"30caa0e5-5eba-4fb8-98e7-c99e892a20c7\") " pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" Oct 30 22:26:22.748510 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:22.748491 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30caa0e5-5eba-4fb8-98e7-c99e892a20c7-proxy-tls\") pod \"splitter-graph-b14c2-774b7488b-2krsk\" (UID: \"30caa0e5-5eba-4fb8-98e7-c99e892a20c7\") " pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" Oct 30 22:26:22.886432 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:22.886377 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" Oct 30 22:26:23.158695 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:23.158623 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk"] Oct 30 22:26:23.162311 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:26:23.162283 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30caa0e5_5eba_4fb8_98e7_c99e892a20c7.slice/crio-d64bdc2b84405c2f3def7aa93584f1866f4993b4400e01accc54bf2f3d739313 WatchSource:0}: Error finding container d64bdc2b84405c2f3def7aa93584f1866f4993b4400e01accc54bf2f3d739313: Status 404 returned error can't find the container with id d64bdc2b84405c2f3def7aa93584f1866f4993b4400e01accc54bf2f3d739313 Oct 30 22:26:24.134329 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:24.134296 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" event={"ID":"30caa0e5-5eba-4fb8-98e7-c99e892a20c7","Type":"ContainerStarted","Data":"1edfded6c469f2bfd1650ed684f7ba65bf0e522c3de1fbd52ddd9de582288a3f"} Oct 30 22:26:24.134713 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:24.134353 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" event={"ID":"30caa0e5-5eba-4fb8-98e7-c99e892a20c7","Type":"ContainerStarted","Data":"d64bdc2b84405c2f3def7aa93584f1866f4993b4400e01accc54bf2f3d739313"} Oct 30 22:26:24.134713 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:24.134384 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" Oct 30 22:26:24.153036 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:24.152990 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" podStartSLOduration=2.152977385 podStartE2EDuration="2.152977385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:26:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:26:24.151798089 +0000 UTC m=+1993.674838822" watchObservedRunningTime="2026-10-30 22:26:24.152977385 +0000 UTC m=+1993.676018118" Oct 30 22:26:28.093786 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:28.093744 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused" Oct 30 22:26:30.143760 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:30.143732 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" Oct 30 22:26:34.065248 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:34.065213 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc"] Oct 30 22:26:34.065649 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:34.065531 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerName="kserve-container" containerID="cri-o://2a7f1e30b4b4f4abed23c37cb5ed34aeb1abe91c66a4a1c3659462130af0a08c" gracePeriod=30 Oct 30 22:26:34.065649 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:34.065546 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerName="kube-rbac-proxy" containerID="cri-o://eafb24a0aaefe1adc9071631773ce15d20110a92f87cf43c3660a3b0c23b3e82" gracePeriod=30 Oct 30 22:26:34.080487 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:34.080461 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:34.184943 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:34.184913 5052 generic.go:356] "Generic (PLEG): container finished" podID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerID="eafb24a0aaefe1adc9071631773ce15d20110a92f87cf43c3660a3b0c23b3e82" exitCode=0 Oct 30 22:26:34.185054 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:34.184953 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" event={"ID":"3609cbe2-0e7e-4878-ba74-4ad6413026d2","Type":"ContainerDied","Data":"eafb24a0aaefe1adc9071631773ce15d20110a92f87cf43c3660a3b0c23b3e82"} Oct 30 22:26:34.186250 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:34.186228 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:34.986908 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:26:34.986846 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:26:35.877092 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:35.877052 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.45:8643/healthz\": dial tcp 10.132.0.45:8643: connect: connection refused" Oct 30 22:26:36.385346 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:36.385310 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:36.488207 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:36.488167 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:37.617290 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:37.617260 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:26:37.777339 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:37.777309 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3609cbe2-0e7e-4878-ba74-4ad6413026d2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3609cbe2-0e7e-4878-ba74-4ad6413026d2-kube-rbac-proxy-sar-config\") pod \"3609cbe2-0e7e-4878-ba74-4ad6413026d2\" (UID: \"3609cbe2-0e7e-4878-ba74-4ad6413026d2\") " Oct 30 22:26:37.777508 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:37.777375 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3609cbe2-0e7e-4878-ba74-4ad6413026d2-kube-api-access-2zrfj\" (UniqueName: \"kubernetes.io/projected/3609cbe2-0e7e-4878-ba74-4ad6413026d2-kube-api-access-2zrfj\") pod \"3609cbe2-0e7e-4878-ba74-4ad6413026d2\" (UID: \"3609cbe2-0e7e-4878-ba74-4ad6413026d2\") " Oct 30 22:26:37.777547 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:37.777508 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3609cbe2-0e7e-4878-ba74-4ad6413026d2-proxy-tls\" (UniqueName: \"kubernetes.io/secret/3609cbe2-0e7e-4878-ba74-4ad6413026d2-proxy-tls\") pod \"3609cbe2-0e7e-4878-ba74-4ad6413026d2\" (UID: \"3609cbe2-0e7e-4878-ba74-4ad6413026d2\") " Oct 30 22:26:37.777676 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:37.777649 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3609cbe2-0e7e-4878-ba74-4ad6413026d2-kube-rbac-proxy-sar-config" pod "3609cbe2-0e7e-4878-ba74-4ad6413026d2" (UID: "3609cbe2-0e7e-4878-ba74-4ad6413026d2"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:26:37.777846 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:37.777823 5052 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3609cbe2-0e7e-4878-ba74-4ad6413026d2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:26:37.779543 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:37.779520 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3609cbe2-0e7e-4878-ba74-4ad6413026d2-proxy-tls" pod "3609cbe2-0e7e-4878-ba74-4ad6413026d2" (UID: "3609cbe2-0e7e-4878-ba74-4ad6413026d2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:26:37.779632 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:37.779616 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3609cbe2-0e7e-4878-ba74-4ad6413026d2-kube-api-access-2zrfj" pod "3609cbe2-0e7e-4878-ba74-4ad6413026d2" (UID: "3609cbe2-0e7e-4878-ba74-4ad6413026d2"). InnerVolumeSpecName "kube-api-access-2zrfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:26:37.878371 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:37.878333 5052 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zrfj\" (UniqueName: \"kubernetes.io/projected/3609cbe2-0e7e-4878-ba74-4ad6413026d2-kube-api-access-2zrfj\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:26:37.878371 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:37.878366 5052 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3609cbe2-0e7e-4878-ba74-4ad6413026d2-proxy-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:26:38.093379 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:38.093293 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused" Oct 30 22:26:38.205701 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:38.205660 5052 generic.go:356] "Generic (PLEG): container finished" podID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerID="2a7f1e30b4b4f4abed23c37cb5ed34aeb1abe91c66a4a1c3659462130af0a08c" exitCode=0 Oct 30 22:26:38.205890 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:38.205714 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" Oct 30 22:26:38.205890 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:38.205732 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" event={"ID":"3609cbe2-0e7e-4878-ba74-4ad6413026d2","Type":"ContainerDied","Data":"2a7f1e30b4b4f4abed23c37cb5ed34aeb1abe91c66a4a1c3659462130af0a08c"} Oct 30 22:26:38.205890 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:38.205810 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc" event={"ID":"3609cbe2-0e7e-4878-ba74-4ad6413026d2","Type":"ContainerDied","Data":"f96543e9f3ff009239e6ef5be9d852b102e7a3fa102ecfc31feeda7e504fd83f"} Oct 30 22:26:38.205890 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:38.205838 5052 scope.go:122] "RemoveContainer" containerID="eafb24a0aaefe1adc9071631773ce15d20110a92f87cf43c3660a3b0c23b3e82" Oct 30 22:26:38.214959 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:38.214939 5052 scope.go:122] "RemoveContainer" containerID="2a7f1e30b4b4f4abed23c37cb5ed34aeb1abe91c66a4a1c3659462130af0a08c" Oct 30 22:26:38.222621 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:38.222602 5052 scope.go:122] "RemoveContainer" containerID="eafb24a0aaefe1adc9071631773ce15d20110a92f87cf43c3660a3b0c23b3e82" Oct 30 22:26:38.222939 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:26:38.222911 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eafb24a0aaefe1adc9071631773ce15d20110a92f87cf43c3660a3b0c23b3e82\": container with ID starting with eafb24a0aaefe1adc9071631773ce15d20110a92f87cf43c3660a3b0c23b3e82 not found: ID does not exist" containerID="eafb24a0aaefe1adc9071631773ce15d20110a92f87cf43c3660a3b0c23b3e82" Oct 30 22:26:38.223041 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:38.222947 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eafb24a0aaefe1adc9071631773ce15d20110a92f87cf43c3660a3b0c23b3e82"} err="failed to get container status \"eafb24a0aaefe1adc9071631773ce15d20110a92f87cf43c3660a3b0c23b3e82\": rpc error: code = NotFound desc = could not find container \"eafb24a0aaefe1adc9071631773ce15d20110a92f87cf43c3660a3b0c23b3e82\": container with ID starting with eafb24a0aaefe1adc9071631773ce15d20110a92f87cf43c3660a3b0c23b3e82 not found: ID does not exist" Oct 30 22:26:38.223041 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:38.222970 5052 scope.go:122] "RemoveContainer" containerID="2a7f1e30b4b4f4abed23c37cb5ed34aeb1abe91c66a4a1c3659462130af0a08c" Oct 30 22:26:38.223242 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:26:38.223222 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a7f1e30b4b4f4abed23c37cb5ed34aeb1abe91c66a4a1c3659462130af0a08c\": container with ID starting with 2a7f1e30b4b4f4abed23c37cb5ed34aeb1abe91c66a4a1c3659462130af0a08c not found: ID does not exist" containerID="2a7f1e30b4b4f4abed23c37cb5ed34aeb1abe91c66a4a1c3659462130af0a08c" Oct 30 22:26:38.223299 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:38.223251 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a7f1e30b4b4f4abed23c37cb5ed34aeb1abe91c66a4a1c3659462130af0a08c"} err="failed to get container status \"2a7f1e30b4b4f4abed23c37cb5ed34aeb1abe91c66a4a1c3659462130af0a08c\": rpc error: code = NotFound desc = could not find container \"2a7f1e30b4b4f4abed23c37cb5ed34aeb1abe91c66a4a1c3659462130af0a08c\": container with ID starting with 2a7f1e30b4b4f4abed23c37cb5ed34aeb1abe91c66a4a1c3659462130af0a08c not found: ID does not exist" Oct 30 22:26:38.228455 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:38.228435 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc"] Oct 30 22:26:38.232956 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:38.232935 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-b14c2-predictor-59d69d67c6-qx5pc"] Oct 30 22:26:38.608560 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:38.608523 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" path="/var/lib/kubelet/pods/3609cbe2-0e7e-4878-ba74-4ad6413026d2/volumes" Oct 30 22:26:39.421446 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.421412 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5"] Oct 30 22:26:39.421813 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.421803 5052 cpu_manager.go:414] "containerMap: removing container" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerName="kserve-container" Oct 30 22:26:39.421876 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.421818 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerName="kserve-container" Oct 30 22:26:39.421876 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.421840 5052 cpu_manager.go:414] "containerMap: removing container" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerName="kube-rbac-proxy" Oct 30 22:26:39.421876 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.421845 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerName="kube-rbac-proxy" Oct 30 22:26:39.421981 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.421941 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerName="kserve-container" Oct 30 22:26:39.421981 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.421954 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="3609cbe2-0e7e-4878-ba74-4ad6413026d2" containerName="kube-rbac-proxy" Oct 30 22:26:39.426565 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.426550 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:26:39.430582 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.430552 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"kube-root-ca.crt\"" Oct 30 22:26:39.431425 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.431408 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"success-200-isvc-e3412-kube-rbac-proxy-sar-config\"" Oct 30 22:26:39.431496 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.431440 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"success-200-isvc-e3412-predictor-serving-cert\"" Oct 30 22:26:39.434994 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.434973 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5"] Oct 30 22:26:39.436121 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.436071 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:39.543979 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.543954 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:39.593188 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.593151 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf8kw\" (UniqueName: \"kubernetes.io/projected/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-kube-api-access-hf8kw\") pod \"success-200-isvc-e3412-predictor-58fd967bf8-mqkf5\" (UID: \"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad\") " pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:26:39.593338 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.593287 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-proxy-tls\") pod \"success-200-isvc-e3412-predictor-58fd967bf8-mqkf5\" (UID: \"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad\") " pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:26:39.593407 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.593371 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-e3412-predictor-58fd967bf8-mqkf5\" (UID: \"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad\") " pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:26:39.649307 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.649267 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:39.694018 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.693944 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-e3412-predictor-58fd967bf8-mqkf5\" (UID: \"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad\") " pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:26:39.694018 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.693991 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf8kw\" (UniqueName: \"kubernetes.io/projected/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-kube-api-access-hf8kw\") pod \"success-200-isvc-e3412-predictor-58fd967bf8-mqkf5\" (UID: \"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad\") " pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:26:39.694228 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.694045 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-proxy-tls\") pod \"success-200-isvc-e3412-predictor-58fd967bf8-mqkf5\" (UID: \"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad\") " pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:26:39.694636 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.694612 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-e3412-predictor-58fd967bf8-mqkf5\" (UID: \"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad\") " pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:26:39.696389 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.696365 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-proxy-tls\") pod \"success-200-isvc-e3412-predictor-58fd967bf8-mqkf5\" (UID: \"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad\") " pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:26:39.706590 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.706566 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf8kw\" (UniqueName: \"kubernetes.io/projected/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-kube-api-access-hf8kw\") pod \"success-200-isvc-e3412-predictor-58fd967bf8-mqkf5\" (UID: \"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad\") " pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:26:39.743601 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.743567 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:26:39.751950 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:39.751925 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:40.020392 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:40.020364 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5"] Oct 30 22:26:40.024036 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:26:40.024009 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d39270b_70e2_4fa2_ad9e_7e9a1c736dad.slice/crio-f69da79a84ec31f806f7d26d7688e4d84e8bd29b417f1835dc95999f9fbf60e3 WatchSource:0}: Error finding container f69da79a84ec31f806f7d26d7688e4d84e8bd29b417f1835dc95999f9fbf60e3: Status 404 returned error can't find the container with id f69da79a84ec31f806f7d26d7688e4d84e8bd29b417f1835dc95999f9fbf60e3 Oct 30 22:26:40.218808 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:40.218766 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" event={"ID":"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad","Type":"ContainerStarted","Data":"589372c6afd35ccfc2f15b911c53c11b94020a1bc31700b171a5e9d05057a4c1"} Oct 30 22:26:40.219037 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:40.218841 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" event={"ID":"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad","Type":"ContainerStarted","Data":"d2854755af21955de9710f45346835646e322a3a1e2460a9ab251f9615065bb9"} Oct 30 22:26:40.219037 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:40.218889 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:26:40.219037 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:40.218918 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:26:40.219037 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:40.218948 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" event={"ID":"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad","Type":"ContainerStarted","Data":"f69da79a84ec31f806f7d26d7688e4d84e8bd29b417f1835dc95999f9fbf60e3"} Oct 30 22:26:40.220316 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:40.220291 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.48:8080: connect: connection refused" Oct 30 22:26:40.238480 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:40.238425 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" podStartSLOduration=1.238408797 podStartE2EDuration="1.238408797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:26:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:26:40.237710212 +0000 UTC m=+2009.760750958" watchObservedRunningTime="2026-10-30 22:26:40.238408797 +0000 UTC m=+2009.761449532" Oct 30 22:26:41.222727 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:41.222691 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.48:8080: connect: connection refused" Oct 30 22:26:46.227950 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:46.227915 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:26:46.228441 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:46.228413 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.48:8080: connect: connection refused" Oct 30 22:26:48.093652 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:48.093615 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused" Oct 30 22:26:52.793381 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:52.793280 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:56.229022 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:56.228987 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.48:8080: connect: connection refused" Oct 30 22:26:58.093948 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:26:58.093904 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused" Oct 30 22:27:01.473629 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:27:01.473588 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:04.985410 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:27:04.985376 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:27:06.229081 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:27:06.229045 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.48:8080: connect: connection refused" Oct 30 22:27:08.093881 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:27:08.093838 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:27:16.228940 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:27:16.228899 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.48:8080: connect: connection refused" Oct 30 22:27:21.285155 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:27:21.285113 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:21.402191 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:27:21.402136 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:26.229364 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:27:26.229329 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.48:8080: connect: connection refused" Oct 30 22:27:34.986226 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:27:34.986185 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:27:36.229678 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:27:36.229649 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:27:49.651528 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:27:49.651493 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:49.820176 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:27:49.820123 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:01.528263 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:28:01.528228 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:04.986340 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:28:04.986303 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:28:10.810633 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:28:10.810606 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:28:10.814120 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:28:10.814094 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:28:34.985971 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:28:34.985931 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:29:01.582050 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:29:01.582010 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:04.986456 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:29:04.986420 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:29:34.986461 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:29:34.986424 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:30:01.669005 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:30:01.668814 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:04.985819 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:30:04.985787 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:30:34.987236 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:30:34.987196 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:31:01.715646 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:31:01.715600 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:31:04.985817 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:31:04.985773 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:31:20.808971 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:31:20.808929 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:31:34.987742 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:31:34.987704 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:32:01.745929 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:32:01.745892 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:04.986583 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:32:04.986543 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:32:34.986487 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:32:34.986451 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:33:01.805122 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:33:01.805088 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:04.986059 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:33:04.986024 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:33:10.837958 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:33:10.837926 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:33:10.841660 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:33:10.841635 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:33:19.268211 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:33:19.268169 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:34.986399 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:33:34.986360 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:34:01.857212 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:34:01.857175 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:34:04.985685 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:34:04.985646 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:34:34.986102 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:34:34.986063 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:35:01.904266 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:35:01.904226 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:35:04.985721 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:35:04.985689 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:35:34.986968 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:35:34.986930 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:36:01.981621 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:01.981528 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:36:04.985788 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:36:04.985755 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:36:05.505410 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:05.505378 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5"] Oct 30 22:36:05.505631 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:05.505586 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kserve-container" containerID="cri-o://d2854755af21955de9710f45346835646e322a3a1e2460a9ab251f9615065bb9" gracePeriod=30 Oct 30 22:36:05.505697 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:05.505669 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kube-rbac-proxy" containerID="cri-o://589372c6afd35ccfc2f15b911c53c11b94020a1bc31700b171a5e9d05057a4c1" gracePeriod=30 Oct 30 22:36:05.514122 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:05.514088 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:36:05.623515 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:05.623489 5052 generic.go:356] "Generic (PLEG): container finished" podID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerID="589372c6afd35ccfc2f15b911c53c11b94020a1bc31700b171a5e9d05057a4c1" exitCode=0 Oct 30 22:36:05.623624 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:05.623547 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" event={"ID":"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad","Type":"ContainerDied","Data":"589372c6afd35ccfc2f15b911c53c11b94020a1bc31700b171a5e9d05057a4c1"} Oct 30 22:36:06.223550 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:06.223514 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.48:8643/healthz\": dial tcp 10.132.0.48:8643: connect: connection refused" Oct 30 22:36:06.228901 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:06.228836 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.48:8080: connect: connection refused" Oct 30 22:36:06.582137 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:06.582101 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:36:08.339497 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.339473 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:36:08.398827 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.398798 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-proxy-tls\") pod \"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad\" (UID: \"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad\") " Oct 30 22:36:08.398980 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.398892 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-kube-api-access-hf8kw\" (UniqueName: \"kubernetes.io/projected/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-kube-api-access-hf8kw\") pod \"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad\" (UID: \"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad\") " Oct 30 22:36:08.398980 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.398945 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-kube-rbac-proxy-sar-config\") pod \"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad\" (UID: \"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad\") " Oct 30 22:36:08.399294 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.399271 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-kube-rbac-proxy-sar-config" pod "8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" (UID: "8d39270b-70e2-4fa2-ad9e-7e9a1c736dad"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:36:08.400883 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.400841 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-kube-api-access-hf8kw" pod "8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" (UID: "8d39270b-70e2-4fa2-ad9e-7e9a1c736dad"). InnerVolumeSpecName "kube-api-access-hf8kw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:36:08.400986 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.400914 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-proxy-tls" pod "8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" (UID: "8d39270b-70e2-4fa2-ad9e-7e9a1c736dad"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:36:08.500152 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.500129 5052 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf8kw\" (UniqueName: \"kubernetes.io/projected/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-kube-api-access-hf8kw\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:36:08.500152 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.500151 5052 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-kube-rbac-proxy-sar-config\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:36:08.500292 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.500160 5052 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad-proxy-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:36:08.636773 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.636742 5052 generic.go:356] "Generic (PLEG): container finished" podID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerID="d2854755af21955de9710f45346835646e322a3a1e2460a9ab251f9615065bb9" exitCode=0 Oct 30 22:36:08.636896 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.636799 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" Oct 30 22:36:08.636896 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.636818 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" event={"ID":"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad","Type":"ContainerDied","Data":"d2854755af21955de9710f45346835646e322a3a1e2460a9ab251f9615065bb9"} Oct 30 22:36:08.636896 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.636889 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5" event={"ID":"8d39270b-70e2-4fa2-ad9e-7e9a1c736dad","Type":"ContainerDied","Data":"f69da79a84ec31f806f7d26d7688e4d84e8bd29b417f1835dc95999f9fbf60e3"} Oct 30 22:36:08.637011 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.636917 5052 scope.go:122] "RemoveContainer" containerID="589372c6afd35ccfc2f15b911c53c11b94020a1bc31700b171a5e9d05057a4c1" Oct 30 22:36:08.645239 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.645220 5052 scope.go:122] "RemoveContainer" containerID="d2854755af21955de9710f45346835646e322a3a1e2460a9ab251f9615065bb9" Oct 30 22:36:08.652552 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.652527 5052 scope.go:122] "RemoveContainer" containerID="589372c6afd35ccfc2f15b911c53c11b94020a1bc31700b171a5e9d05057a4c1" Oct 30 22:36:08.652806 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:36:08.652788 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"589372c6afd35ccfc2f15b911c53c11b94020a1bc31700b171a5e9d05057a4c1\": container with ID starting with 589372c6afd35ccfc2f15b911c53c11b94020a1bc31700b171a5e9d05057a4c1 not found: ID does not exist" containerID="589372c6afd35ccfc2f15b911c53c11b94020a1bc31700b171a5e9d05057a4c1" Oct 30 22:36:08.652870 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.652815 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"589372c6afd35ccfc2f15b911c53c11b94020a1bc31700b171a5e9d05057a4c1"} err="failed to get container status \"589372c6afd35ccfc2f15b911c53c11b94020a1bc31700b171a5e9d05057a4c1\": rpc error: code = NotFound desc = could not find container \"589372c6afd35ccfc2f15b911c53c11b94020a1bc31700b171a5e9d05057a4c1\": container with ID starting with 589372c6afd35ccfc2f15b911c53c11b94020a1bc31700b171a5e9d05057a4c1 not found: ID does not exist" Oct 30 22:36:08.652870 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.652832 5052 scope.go:122] "RemoveContainer" containerID="d2854755af21955de9710f45346835646e322a3a1e2460a9ab251f9615065bb9" Oct 30 22:36:08.653123 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:36:08.653108 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2854755af21955de9710f45346835646e322a3a1e2460a9ab251f9615065bb9\": container with ID starting with d2854755af21955de9710f45346835646e322a3a1e2460a9ab251f9615065bb9 not found: ID does not exist" containerID="d2854755af21955de9710f45346835646e322a3a1e2460a9ab251f9615065bb9" Oct 30 22:36:08.653177 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.653128 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2854755af21955de9710f45346835646e322a3a1e2460a9ab251f9615065bb9"} err="failed to get container status \"d2854755af21955de9710f45346835646e322a3a1e2460a9ab251f9615065bb9\": rpc error: code = NotFound desc = could not find container \"d2854755af21955de9710f45346835646e322a3a1e2460a9ab251f9615065bb9\": container with ID starting with d2854755af21955de9710f45346835646e322a3a1e2460a9ab251f9615065bb9 not found: ID does not exist" Oct 30 22:36:08.655239 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.655218 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5"] Oct 30 22:36:08.659525 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:08.659505 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-36e5afb065/success-200-isvc-e3412-predictor-58fd967bf8-mqkf5"] Oct 30 22:36:10.608559 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:10.608528 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" path="/var/lib/kubelet/pods/8d39270b-70e2-4fa2-ad9e-7e9a1c736dad/volumes" Oct 30 22:36:10.635376 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:10.635348 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:36:15.602069 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:15.602035 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk"] Oct 30 22:36:15.602642 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:15.602365 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" podUID="30caa0e5-5eba-4fb8-98e7-c99e892a20c7" containerName="splitter-graph-b14c2" containerID="cri-o://1edfded6c469f2bfd1650ed684f7ba65bf0e522c3de1fbd52ddd9de582288a3f" gracePeriod=30 Oct 30 22:36:15.618501 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:15.618468 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n"] Oct 30 22:36:15.618671 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:15.618635 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" podUID="0ff95ba5-a945-4695-a432-3ab8af8093ad" containerName="switch-graph-3c7da" containerID="cri-o://0152a73207bc571198d9a88d1e17cc8b5b1377445b55e6e8a9d072639ef5ae9f" gracePeriod=30 Oct 30 22:36:15.627362 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:15.627332 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf"] Oct 30 22:36:15.627516 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:15.627496 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" podUID="a45babc0-c279-42f0-a0a0-042aaf4b7b0b" containerName="switch-graph-7f5ed" containerID="cri-o://8a05e2300cf79ae060729d501094216537a3b5ba264e22c06bc216293d74b6ae" gracePeriod=30 Oct 30 22:36:15.787611 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:15.787574 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:36:15.906246 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:15.906212 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" podUID="0ff95ba5-a945-4695-a432-3ab8af8093ad" containerName="switch-graph-3c7da" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:16.544370 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:16.544325 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" podUID="a45babc0-c279-42f0-a0a0-042aaf4b7b0b" containerName="switch-graph-7f5ed" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:20.142424 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:20.142380 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" podUID="30caa0e5-5eba-4fb8-98e7-c99e892a20c7" containerName="splitter-graph-b14c2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:20.906424 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:20.906387 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" podUID="0ff95ba5-a945-4695-a432-3ab8af8093ad" containerName="switch-graph-3c7da" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:21.544539 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:21.544504 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" podUID="a45babc0-c279-42f0-a0a0-042aaf4b7b0b" containerName="switch-graph-7f5ed" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:25.142116 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:25.142080 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" podUID="30caa0e5-5eba-4fb8-98e7-c99e892a20c7" containerName="splitter-graph-b14c2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:25.905803 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:25.905767 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" podUID="0ff95ba5-a945-4695-a432-3ab8af8093ad" containerName="switch-graph-3c7da" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:25.905994 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:25.905881 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" Oct 30 22:36:26.544411 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:26.544370 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" podUID="a45babc0-c279-42f0-a0a0-042aaf4b7b0b" containerName="switch-graph-7f5ed" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:26.544903 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:26.544474 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" Oct 30 22:36:30.142105 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:30.142067 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" podUID="30caa0e5-5eba-4fb8-98e7-c99e892a20c7" containerName="splitter-graph-b14c2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:30.142524 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:30.142175 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" Oct 30 22:36:30.906193 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:30.906157 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" podUID="0ff95ba5-a945-4695-a432-3ab8af8093ad" containerName="switch-graph-3c7da" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:31.544333 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:31.544293 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" podUID="a45babc0-c279-42f0-a0a0-042aaf4b7b0b" containerName="switch-graph-7f5ed" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:34.986011 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:36:34.985968 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:36:35.142613 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:35.142566 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" podUID="30caa0e5-5eba-4fb8-98e7-c99e892a20c7" containerName="splitter-graph-b14c2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:35.905966 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:35.905933 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" podUID="0ff95ba5-a945-4695-a432-3ab8af8093ad" containerName="switch-graph-3c7da" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:36.544235 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:36.544200 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" podUID="a45babc0-c279-42f0-a0a0-042aaf4b7b0b" containerName="switch-graph-7f5ed" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:37.742753 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:37.742710 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:36:40.143008 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:40.142966 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" podUID="30caa0e5-5eba-4fb8-98e7-c99e892a20c7" containerName="splitter-graph-b14c2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:40.906574 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:40.906538 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" podUID="0ff95ba5-a945-4695-a432-3ab8af8093ad" containerName="switch-graph-3c7da" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:41.544660 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:41.544616 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" podUID="a45babc0-c279-42f0-a0a0-042aaf4b7b0b" containerName="switch-graph-7f5ed" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:45.141996 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.141952 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" podUID="30caa0e5-5eba-4fb8-98e7-c99e892a20c7" containerName="splitter-graph-b14c2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:36:45.791481 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.791455 5052 generic.go:356] "Generic (PLEG): container finished" podID="a45babc0-c279-42f0-a0a0-042aaf4b7b0b" containerID="8a05e2300cf79ae060729d501094216537a3b5ba264e22c06bc216293d74b6ae" exitCode=137 Oct 30 22:36:45.791598 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.791528 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" event={"ID":"a45babc0-c279-42f0-a0a0-042aaf4b7b0b","Type":"ContainerDied","Data":"8a05e2300cf79ae060729d501094216537a3b5ba264e22c06bc216293d74b6ae"} Oct 30 22:36:45.791598 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.791588 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" event={"ID":"a45babc0-c279-42f0-a0a0-042aaf4b7b0b","Type":"ContainerDied","Data":"15dd5b94c733f6e27a7fffc3f79be9c5781aae9ccb3fa1b437e5734875dee472"} Oct 30 22:36:45.791688 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.791611 5052 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15dd5b94c733f6e27a7fffc3f79be9c5781aae9ccb3fa1b437e5734875dee472" Oct 30 22:36:45.792765 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.792745 5052 generic.go:356] "Generic (PLEG): container finished" podID="0ff95ba5-a945-4695-a432-3ab8af8093ad" containerID="0152a73207bc571198d9a88d1e17cc8b5b1377445b55e6e8a9d072639ef5ae9f" exitCode=137 Oct 30 22:36:45.792879 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.792817 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" event={"ID":"0ff95ba5-a945-4695-a432-3ab8af8093ad","Type":"ContainerDied","Data":"0152a73207bc571198d9a88d1e17cc8b5b1377445b55e6e8a9d072639ef5ae9f"} Oct 30 22:36:45.794039 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.794015 5052 generic.go:356] "Generic (PLEG): container finished" podID="30caa0e5-5eba-4fb8-98e7-c99e892a20c7" containerID="1edfded6c469f2bfd1650ed684f7ba65bf0e522c3de1fbd52ddd9de582288a3f" exitCode=0 Oct 30 22:36:45.794118 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.794078 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" event={"ID":"30caa0e5-5eba-4fb8-98e7-c99e892a20c7","Type":"ContainerDied","Data":"1edfded6c469f2bfd1650ed684f7ba65bf0e522c3de1fbd52ddd9de582288a3f"} Oct 30 22:36:45.794159 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.794119 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" event={"ID":"30caa0e5-5eba-4fb8-98e7-c99e892a20c7","Type":"ContainerDied","Data":"d64bdc2b84405c2f3def7aa93584f1866f4993b4400e01accc54bf2f3d739313"} Oct 30 22:36:45.794159 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.794137 5052 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d64bdc2b84405c2f3def7aa93584f1866f4993b4400e01accc54bf2f3d739313" Oct 30 22:36:45.805219 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.805203 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" Oct 30 22:36:45.808128 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.808112 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" Oct 30 22:36:45.811468 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.811451 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" Oct 30 22:36:45.870908 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.870791 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0ff95ba5-a945-4695-a432-3ab8af8093ad-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ff95ba5-a945-4695-a432-3ab8af8093ad-openshift-service-ca-bundle\") pod \"0ff95ba5-a945-4695-a432-3ab8af8093ad\" (UID: \"0ff95ba5-a945-4695-a432-3ab8af8093ad\") " Oct 30 22:36:45.871057 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.870956 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/30caa0e5-5eba-4fb8-98e7-c99e892a20c7-proxy-tls\" (UniqueName: \"kubernetes.io/secret/30caa0e5-5eba-4fb8-98e7-c99e892a20c7-proxy-tls\") pod \"30caa0e5-5eba-4fb8-98e7-c99e892a20c7\" (UID: \"30caa0e5-5eba-4fb8-98e7-c99e892a20c7\") " Oct 30 22:36:45.871057 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.871006 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a45babc0-c279-42f0-a0a0-042aaf4b7b0b-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a45babc0-c279-42f0-a0a0-042aaf4b7b0b-openshift-service-ca-bundle\") pod \"a45babc0-c279-42f0-a0a0-042aaf4b7b0b\" (UID: \"a45babc0-c279-42f0-a0a0-042aaf4b7b0b\") " Oct 30 22:36:45.871057 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.871034 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a45babc0-c279-42f0-a0a0-042aaf4b7b0b-proxy-tls\" (UniqueName: \"kubernetes.io/secret/a45babc0-c279-42f0-a0a0-042aaf4b7b0b-proxy-tls\") pod \"a45babc0-c279-42f0-a0a0-042aaf4b7b0b\" (UID: \"a45babc0-c279-42f0-a0a0-042aaf4b7b0b\") " Oct 30 22:36:45.871167 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.871095 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/30caa0e5-5eba-4fb8-98e7-c99e892a20c7-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30caa0e5-5eba-4fb8-98e7-c99e892a20c7-openshift-service-ca-bundle\") pod \"30caa0e5-5eba-4fb8-98e7-c99e892a20c7\" (UID: \"30caa0e5-5eba-4fb8-98e7-c99e892a20c7\") " Oct 30 22:36:45.871167 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.871136 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ff95ba5-a945-4695-a432-3ab8af8093ad-proxy-tls\" (UniqueName: \"kubernetes.io/secret/0ff95ba5-a945-4695-a432-3ab8af8093ad-proxy-tls\") pod \"0ff95ba5-a945-4695-a432-3ab8af8093ad\" (UID: \"0ff95ba5-a945-4695-a432-3ab8af8093ad\") " Oct 30 22:36:45.877036 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.876999 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ff95ba5-a945-4695-a432-3ab8af8093ad-proxy-tls" pod "0ff95ba5-a945-4695-a432-3ab8af8093ad" (UID: "0ff95ba5-a945-4695-a432-3ab8af8093ad"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:36:45.877036 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.877016 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a45babc0-c279-42f0-a0a0-042aaf4b7b0b-openshift-service-ca-bundle" pod "a45babc0-c279-42f0-a0a0-042aaf4b7b0b" (UID: "a45babc0-c279-42f0-a0a0-042aaf4b7b0b"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:36:45.877317 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.877071 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30caa0e5-5eba-4fb8-98e7-c99e892a20c7-proxy-tls" pod "30caa0e5-5eba-4fb8-98e7-c99e892a20c7" (UID: "30caa0e5-5eba-4fb8-98e7-c99e892a20c7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:36:45.877317 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.877081 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ff95ba5-a945-4695-a432-3ab8af8093ad-openshift-service-ca-bundle" pod "0ff95ba5-a945-4695-a432-3ab8af8093ad" (UID: "0ff95ba5-a945-4695-a432-3ab8af8093ad"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:36:45.877317 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.877109 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a45babc0-c279-42f0-a0a0-042aaf4b7b0b-proxy-tls" pod "a45babc0-c279-42f0-a0a0-042aaf4b7b0b" (UID: "a45babc0-c279-42f0-a0a0-042aaf4b7b0b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:36:45.877317 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.877129 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30caa0e5-5eba-4fb8-98e7-c99e892a20c7-openshift-service-ca-bundle" pod "30caa0e5-5eba-4fb8-98e7-c99e892a20c7" (UID: "30caa0e5-5eba-4fb8-98e7-c99e892a20c7"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:36:45.972639 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.972604 5052 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30caa0e5-5eba-4fb8-98e7-c99e892a20c7-openshift-service-ca-bundle\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:36:45.972639 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.972635 5052 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0ff95ba5-a945-4695-a432-3ab8af8093ad-proxy-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:36:45.972639 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.972647 5052 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ff95ba5-a945-4695-a432-3ab8af8093ad-openshift-service-ca-bundle\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:36:45.972900 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.972657 5052 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30caa0e5-5eba-4fb8-98e7-c99e892a20c7-proxy-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:36:45.972900 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.972666 5052 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a45babc0-c279-42f0-a0a0-042aaf4b7b0b-openshift-service-ca-bundle\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:36:45.972900 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:45.972677 5052 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a45babc0-c279-42f0-a0a0-042aaf4b7b0b-proxy-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:36:46.799913 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:46.799882 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" Oct 30 22:36:46.800391 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:46.799878 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n" event={"ID":"0ff95ba5-a945-4695-a432-3ab8af8093ad","Type":"ContainerDied","Data":"37d9092b938f98a0f43085a8e45e272a4d0265bdb010877a78778c2680c0d416"} Oct 30 22:36:46.800391 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:46.800026 5052 scope.go:122] "RemoveContainer" containerID="0152a73207bc571198d9a88d1e17cc8b5b1377445b55e6e8a9d072639ef5ae9f" Oct 30 22:36:46.800391 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:46.800077 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk" Oct 30 22:36:46.800391 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:46.800172 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf" Oct 30 22:36:46.823095 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:46.823069 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk"] Oct 30 22:36:46.827386 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:46.827365 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-36e5afb065/splitter-graph-b14c2-774b7488b-2krsk"] Oct 30 22:36:46.838456 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:46.838435 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf"] Oct 30 22:36:46.840804 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:46.840781 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-36e5afb065/switch-graph-7f5ed-78948d76cb-nv8qf"] Oct 30 22:36:46.851642 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:46.851620 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n"] Oct 30 22:36:46.857594 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:46.857575 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-36e5afb065/switch-graph-3c7da-79f95f464b-ksn9n"] Oct 30 22:36:48.608996 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:48.608962 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0ff95ba5-a945-4695-a432-3ab8af8093ad" path="/var/lib/kubelet/pods/0ff95ba5-a945-4695-a432-3ab8af8093ad/volumes" Oct 30 22:36:48.609384 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:48.609295 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="30caa0e5-5eba-4fb8-98e7-c99e892a20c7" path="/var/lib/kubelet/pods/30caa0e5-5eba-4fb8-98e7-c99e892a20c7/volumes" Oct 30 22:36:48.609603 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:48.609591 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a45babc0-c279-42f0-a0a0-042aaf4b7b0b" path="/var/lib/kubelet/pods/a45babc0-c279-42f0-a0a0-042aaf4b7b0b/volumes" Oct 30 22:36:53.018308 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:53.018270 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:36:53.125401 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:53.125366 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:36:55.142297 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:36:55.142262 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:00.614408 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:37:00.614375 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:00.749658 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:37:00.749624 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:02.000994 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:37:02.000946 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:04.985317 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:37:04.985280 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:37:10.911427 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:37:10.911399 5052 scope.go:122] "RemoveContainer" containerID="1edfded6c469f2bfd1650ed684f7ba65bf0e522c3de1fbd52ddd9de582288a3f" Oct 30 22:37:10.918910 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:37:10.918893 5052 scope.go:122] "RemoveContainer" containerID="8a05e2300cf79ae060729d501094216537a3b5ba264e22c06bc216293d74b6ae" Oct 30 22:37:34.986270 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:37:34.986228 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:38:02.061704 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:38:02.061665 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:38:04.985830 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:38:04.985789 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:38:10.863932 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:38:10.863906 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:38:10.868327 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:38:10.868302 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:38:34.986287 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:38:34.986244 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:39:02.180517 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:39:02.180436 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:39:04.987403 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:39:04.987366 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:39:34.986753 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:39:34.986715 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:40:02.178023 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:40:02.177985 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:04.986683 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:40:04.986644 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:40:13.789655 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:40:13.789598 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:34.985934 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:40:34.985897 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:40:57.922969 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:40:57.922931 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:41:02.245212 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:41:02.245156 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:41:04.985673 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:41:04.985626 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:41:34.986020 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:41:34.985983 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:42:02.289442 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:42:02.289345 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:42:04.985720 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:42:04.985685 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:42:24.613274 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:42:24.613223 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:42:34.986548 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:42:34.986510 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:43:02.368011 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:02.367978 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:43:04.986034 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:43:04.985996 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:43:10.889708 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:10.889675 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:43:10.893982 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:10.893958 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:43:34.986672 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:43:34.986632 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:43:42.557456 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:42.557423 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g"] Oct 30 22:43:42.557934 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:42.557644 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kserve-container" containerID="cri-o://80ecf8628b0013c982c1652d1a665bd85d3a613293949ef053d46d3bef725128" gracePeriod=30 Oct 30 22:43:42.557934 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:42.557721 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kube-rbac-proxy" containerID="cri-o://f75f2b0b59febe12a5d816031526a5c2d2424b69cdfdd4f0ba9ab3447b8f6521" gracePeriod=30 Oct 30 22:43:42.576725 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:43:42.576685 5052 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c05206f_5658_462c_bf04_a34719028652.slice/crio-conmon-f75f2b0b59febe12a5d816031526a5c2d2424b69cdfdd4f0ba9ab3447b8f6521.scope\": RecentStats: unable to find data in memory cache]" Oct 30 22:43:42.593226 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:42.593177 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:43:42.700206 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:42.700173 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:43:43.088339 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:43.088295 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.46:8643/healthz\": dial tcp 10.132.0.46:8643: connect: connection refused" Oct 30 22:43:43.512320 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:43.512285 5052 generic.go:356] "Generic (PLEG): container finished" podID="3c05206f-5658-462c-bf04-a34719028652" containerID="f75f2b0b59febe12a5d816031526a5c2d2424b69cdfdd4f0ba9ab3447b8f6521" exitCode=0 Oct 30 22:43:43.512490 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:43.512358 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" event={"ID":"3c05206f-5658-462c-bf04-a34719028652","Type":"ContainerDied","Data":"f75f2b0b59febe12a5d816031526a5c2d2424b69cdfdd4f0ba9ab3447b8f6521"} Oct 30 22:43:45.705532 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:45.705509 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:43:45.768112 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:45.768084 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3c05206f-5658-462c-bf04-a34719028652-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3c05206f-5658-462c-bf04-a34719028652-kube-rbac-proxy-sar-config\") pod \"3c05206f-5658-462c-bf04-a34719028652\" (UID: \"3c05206f-5658-462c-bf04-a34719028652\") " Oct 30 22:43:45.768283 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:45.768168 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3c05206f-5658-462c-bf04-a34719028652-proxy-tls\" (UniqueName: \"kubernetes.io/secret/3c05206f-5658-462c-bf04-a34719028652-proxy-tls\") pod \"3c05206f-5658-462c-bf04-a34719028652\" (UID: \"3c05206f-5658-462c-bf04-a34719028652\") " Oct 30 22:43:45.768283 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:45.768248 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3c05206f-5658-462c-bf04-a34719028652-kube-api-access-hx7pq\" (UniqueName: \"kubernetes.io/projected/3c05206f-5658-462c-bf04-a34719028652-kube-api-access-hx7pq\") pod \"3c05206f-5658-462c-bf04-a34719028652\" (UID: \"3c05206f-5658-462c-bf04-a34719028652\") " Oct 30 22:43:45.768439 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:45.768416 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c05206f-5658-462c-bf04-a34719028652-kube-rbac-proxy-sar-config" pod "3c05206f-5658-462c-bf04-a34719028652" (UID: "3c05206f-5658-462c-bf04-a34719028652"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:43:45.770233 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:45.770206 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c05206f-5658-462c-bf04-a34719028652-proxy-tls" pod "3c05206f-5658-462c-bf04-a34719028652" (UID: "3c05206f-5658-462c-bf04-a34719028652"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:43:45.770321 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:45.770277 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c05206f-5658-462c-bf04-a34719028652-kube-api-access-hx7pq" pod "3c05206f-5658-462c-bf04-a34719028652" (UID: "3c05206f-5658-462c-bf04-a34719028652"). InnerVolumeSpecName "kube-api-access-hx7pq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:43:45.869101 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:45.869063 5052 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3c05206f-5658-462c-bf04-a34719028652-proxy-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:43:45.869101 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:45.869095 5052 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx7pq\" (UniqueName: \"kubernetes.io/projected/3c05206f-5658-462c-bf04-a34719028652-kube-api-access-hx7pq\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:43:45.869284 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:45.869111 5052 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3c05206f-5658-462c-bf04-a34719028652-kube-rbac-proxy-sar-config\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:43:46.527844 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:46.527810 5052 generic.go:356] "Generic (PLEG): container finished" podID="3c05206f-5658-462c-bf04-a34719028652" containerID="80ecf8628b0013c982c1652d1a665bd85d3a613293949ef053d46d3bef725128" exitCode=0 Oct 30 22:43:46.528047 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:46.527875 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" event={"ID":"3c05206f-5658-462c-bf04-a34719028652","Type":"ContainerDied","Data":"80ecf8628b0013c982c1652d1a665bd85d3a613293949ef053d46d3bef725128"} Oct 30 22:43:46.528047 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:46.527889 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" Oct 30 22:43:46.528047 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:46.527927 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g" event={"ID":"3c05206f-5658-462c-bf04-a34719028652","Type":"ContainerDied","Data":"24d8f47041c028c6a31bb3bddb4b58293c62b53096b02ae8bf556fe662097250"} Oct 30 22:43:46.528047 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:46.527961 5052 scope.go:122] "RemoveContainer" containerID="f75f2b0b59febe12a5d816031526a5c2d2424b69cdfdd4f0ba9ab3447b8f6521" Oct 30 22:43:46.537137 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:46.537121 5052 scope.go:122] "RemoveContainer" containerID="80ecf8628b0013c982c1652d1a665bd85d3a613293949ef053d46d3bef725128" Oct 30 22:43:46.544394 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:46.544376 5052 scope.go:122] "RemoveContainer" containerID="f75f2b0b59febe12a5d816031526a5c2d2424b69cdfdd4f0ba9ab3447b8f6521" Oct 30 22:43:46.544636 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:43:46.544614 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f75f2b0b59febe12a5d816031526a5c2d2424b69cdfdd4f0ba9ab3447b8f6521\": container with ID starting with f75f2b0b59febe12a5d816031526a5c2d2424b69cdfdd4f0ba9ab3447b8f6521 not found: ID does not exist" containerID="f75f2b0b59febe12a5d816031526a5c2d2424b69cdfdd4f0ba9ab3447b8f6521" Oct 30 22:43:46.544711 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:46.544649 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f75f2b0b59febe12a5d816031526a5c2d2424b69cdfdd4f0ba9ab3447b8f6521"} err="failed to get container status \"f75f2b0b59febe12a5d816031526a5c2d2424b69cdfdd4f0ba9ab3447b8f6521\": rpc error: code = NotFound desc = could not find container \"f75f2b0b59febe12a5d816031526a5c2d2424b69cdfdd4f0ba9ab3447b8f6521\": container with ID starting with f75f2b0b59febe12a5d816031526a5c2d2424b69cdfdd4f0ba9ab3447b8f6521 not found: ID does not exist" Oct 30 22:43:46.544711 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:46.544673 5052 scope.go:122] "RemoveContainer" containerID="80ecf8628b0013c982c1652d1a665bd85d3a613293949ef053d46d3bef725128" Oct 30 22:43:46.544973 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:43:46.544955 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80ecf8628b0013c982c1652d1a665bd85d3a613293949ef053d46d3bef725128\": container with ID starting with 80ecf8628b0013c982c1652d1a665bd85d3a613293949ef053d46d3bef725128 not found: ID does not exist" containerID="80ecf8628b0013c982c1652d1a665bd85d3a613293949ef053d46d3bef725128" Oct 30 22:43:46.545021 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:46.544980 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ecf8628b0013c982c1652d1a665bd85d3a613293949ef053d46d3bef725128"} err="failed to get container status \"80ecf8628b0013c982c1652d1a665bd85d3a613293949ef053d46d3bef725128\": rpc error: code = NotFound desc = could not find container \"80ecf8628b0013c982c1652d1a665bd85d3a613293949ef053d46d3bef725128\": container with ID starting with 80ecf8628b0013c982c1652d1a665bd85d3a613293949ef053d46d3bef725128 not found: ID does not exist" Oct 30 22:43:46.551361 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:46.551341 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g"] Oct 30 22:43:46.556212 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:46.556191 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-a3ce8b9d69/success-200-isvc-18df3-predictor-5d95b78944-cmx2g"] Oct 30 22:43:46.608639 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:46.608609 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3c05206f-5658-462c-bf04-a34719028652" path="/var/lib/kubelet/pods/3c05206f-5658-462c-bf04-a34719028652/volumes" Oct 30 22:43:47.700488 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:47.700456 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:43:49.770299 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:49.770268 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:43:49.879231 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:49.879196 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:43:52.660034 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:52.660000 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j"] Oct 30 22:43:52.660407 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:52.660186 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" podUID="f51a0c9e-6e5b-4220-aa8e-d3edd389b738" containerName="model-chainer" containerID="cri-o://8721d2b314402a4917a116ceab2e0d104e454fa73b1a47a12747f5181ee9ce74" gracePeriod=30 Oct 30 22:43:52.679499 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:52.679471 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj"] Oct 30 22:43:52.679665 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:52.679646 5052 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" podUID="5d26654b-c9a9-448a-a226-81e5c6a7871f" containerName="sequence-graph-e9913" containerID="cri-o://7a73ac600f6076f7b4f2b5d44e557c31586e9944613f176e7b37b8e5daeb13c8" gracePeriod=30 Oct 30 22:43:52.774678 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:52.774601 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:43:54.106021 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:54.105978 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" podUID="5d26654b-c9a9-448a-a226-81e5c6a7871f" containerName="sequence-graph-e9913" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:43:54.731996 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:54.731961 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" podUID="f51a0c9e-6e5b-4220-aa8e-d3edd389b738" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:43:59.106064 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:59.106028 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" podUID="5d26654b-c9a9-448a-a226-81e5c6a7871f" containerName="sequence-graph-e9913" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:43:59.731848 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:43:59.731804 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" podUID="f51a0c9e-6e5b-4220-aa8e-d3edd389b738" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:44:02.394743 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:02.394696 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:44:04.105831 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:04.105798 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" podUID="5d26654b-c9a9-448a-a226-81e5c6a7871f" containerName="sequence-graph-e9913" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:44:04.106224 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:04.105930 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" Oct 30 22:44:04.731395 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:04.731342 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" podUID="f51a0c9e-6e5b-4220-aa8e-d3edd389b738" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:44:04.731609 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:04.731474 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" Oct 30 22:44:04.985474 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:44:04.985387 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:44:06.384576 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:06.384545 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:06.521990 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:06.521962 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:07.271908 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:07.271847 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:07.325119 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:07.325091 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:08.053622 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:08.053593 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:08.116018 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:08.115977 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:08.852223 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:08.852195 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:08.928069 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:08.928033 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:09.106483 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:09.106400 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" podUID="5d26654b-c9a9-448a-a226-81e5c6a7871f" containerName="sequence-graph-e9913" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:44:09.663602 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:09.663577 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:09.718232 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:09.718184 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:09.731713 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:09.731685 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" podUID="f51a0c9e-6e5b-4220-aa8e-d3edd389b738" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:44:10.451763 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:10.451732 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:10.510222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:10.510193 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:11.249798 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:11.249705 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:11.304194 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:11.304162 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:12.047550 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:12.047516 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:12.112506 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:12.112481 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:12.849344 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:12.849288 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:12.905641 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:12.905615 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:13.641285 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:13.641254 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:13.702832 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:13.702809 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:14.106347 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:14.106315 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" podUID="5d26654b-c9a9-448a-a226-81e5c6a7871f" containerName="sequence-graph-e9913" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:44:14.453790 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:14.453705 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:14.505281 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:14.505250 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:14.731936 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:14.731904 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" podUID="f51a0c9e-6e5b-4220-aa8e-d3edd389b738" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:44:15.227545 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:15.227510 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:15.280617 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:15.280592 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:16.020905 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:16.020854 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:16.073809 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:16.073780 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:16.819986 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:16.819957 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:16.877836 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:16.877801 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:17.720049 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:17.720017 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:17.774184 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:17.774140 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:18.553181 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:18.553150 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:18.607389 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:18.607358 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:19.106248 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:19.106215 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" podUID="5d26654b-c9a9-448a-a226-81e5c6a7871f" containerName="sequence-graph-e9913" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:44:19.455419 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:19.455334 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:19.512637 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:19.512604 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:19.731126 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:19.731090 5052 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" podUID="f51a0c9e-6e5b-4220-aa8e-d3edd389b738" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:44:20.260056 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:20.260025 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:20.343243 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:20.343217 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:21.078175 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:21.078145 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:21.135035 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:21.134993 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:21.866763 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:21.866732 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:21.924988 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:21.924961 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:22.645787 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.645757 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_model-chainer-69f597b54c-8hb4j_f51a0c9e-6e5b-4220-aa8e-d3edd389b738/model-chainer/0.log" Oct 30 22:44:22.699673 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.699646 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a3ce8b9d69_sequence-graph-e9913-767b8c8c7d-kzdqj_5d26654b-c9a9-448a-a226-81e5c6a7871f/sequence-graph-e9913/0.log" Oct 30 22:44:22.813453 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.813432 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" Oct 30 22:44:22.842225 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.842201 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" Oct 30 22:44:22.857973 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.857947 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f51a0c9e-6e5b-4220-aa8e-d3edd389b738-proxy-tls\" (UniqueName: \"kubernetes.io/secret/f51a0c9e-6e5b-4220-aa8e-d3edd389b738-proxy-tls\") pod \"f51a0c9e-6e5b-4220-aa8e-d3edd389b738\" (UID: \"f51a0c9e-6e5b-4220-aa8e-d3edd389b738\") " Oct 30 22:44:22.858105 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.857989 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f51a0c9e-6e5b-4220-aa8e-d3edd389b738-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f51a0c9e-6e5b-4220-aa8e-d3edd389b738-openshift-service-ca-bundle\") pod \"f51a0c9e-6e5b-4220-aa8e-d3edd389b738\" (UID: \"f51a0c9e-6e5b-4220-aa8e-d3edd389b738\") " Oct 30 22:44:22.858105 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.858026 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5d26654b-c9a9-448a-a226-81e5c6a7871f-proxy-tls\" (UniqueName: \"kubernetes.io/secret/5d26654b-c9a9-448a-a226-81e5c6a7871f-proxy-tls\") pod \"5d26654b-c9a9-448a-a226-81e5c6a7871f\" (UID: \"5d26654b-c9a9-448a-a226-81e5c6a7871f\") " Oct 30 22:44:22.858105 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.858097 5052 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5d26654b-c9a9-448a-a226-81e5c6a7871f-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d26654b-c9a9-448a-a226-81e5c6a7871f-openshift-service-ca-bundle\") pod \"5d26654b-c9a9-448a-a226-81e5c6a7871f\" (UID: \"5d26654b-c9a9-448a-a226-81e5c6a7871f\") " Oct 30 22:44:22.858467 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.858443 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f51a0c9e-6e5b-4220-aa8e-d3edd389b738-openshift-service-ca-bundle" pod "f51a0c9e-6e5b-4220-aa8e-d3edd389b738" (UID: "f51a0c9e-6e5b-4220-aa8e-d3edd389b738"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:44:22.858548 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.858494 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d26654b-c9a9-448a-a226-81e5c6a7871f-openshift-service-ca-bundle" pod "5d26654b-c9a9-448a-a226-81e5c6a7871f" (UID: "5d26654b-c9a9-448a-a226-81e5c6a7871f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:44:22.859991 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.859966 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f51a0c9e-6e5b-4220-aa8e-d3edd389b738-proxy-tls" pod "f51a0c9e-6e5b-4220-aa8e-d3edd389b738" (UID: "f51a0c9e-6e5b-4220-aa8e-d3edd389b738"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:44:22.860206 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.860182 5052 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d26654b-c9a9-448a-a226-81e5c6a7871f-proxy-tls" pod "5d26654b-c9a9-448a-a226-81e5c6a7871f" (UID: "5d26654b-c9a9-448a-a226-81e5c6a7871f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:44:22.958711 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.958647 5052 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d26654b-c9a9-448a-a226-81e5c6a7871f-openshift-service-ca-bundle\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:44:22.958711 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.958671 5052 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f51a0c9e-6e5b-4220-aa8e-d3edd389b738-proxy-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:44:22.958711 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.958682 5052 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f51a0c9e-6e5b-4220-aa8e-d3edd389b738-openshift-service-ca-bundle\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:44:22.958711 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:22.958694 5052 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5d26654b-c9a9-448a-a226-81e5c6a7871f-proxy-tls\") on node \"ip-10-0-140-139.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:44:23.676178 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.676149 5052 generic.go:356] "Generic (PLEG): container finished" podID="f51a0c9e-6e5b-4220-aa8e-d3edd389b738" containerID="8721d2b314402a4917a116ceab2e0d104e454fa73b1a47a12747f5181ee9ce74" exitCode=0 Oct 30 22:44:23.676311 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.676196 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" Oct 30 22:44:23.676311 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.676241 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" event={"ID":"f51a0c9e-6e5b-4220-aa8e-d3edd389b738","Type":"ContainerDied","Data":"8721d2b314402a4917a116ceab2e0d104e454fa73b1a47a12747f5181ee9ce74"} Oct 30 22:44:23.676311 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.676296 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j" event={"ID":"f51a0c9e-6e5b-4220-aa8e-d3edd389b738","Type":"ContainerDied","Data":"1674237253f02eb3194918789ae09971be1500baf5149c401c85020d9a579e4b"} Oct 30 22:44:23.676489 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.676330 5052 scope.go:122] "RemoveContainer" containerID="8721d2b314402a4917a116ceab2e0d104e454fa73b1a47a12747f5181ee9ce74" Oct 30 22:44:23.677770 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.677551 5052 generic.go:356] "Generic (PLEG): container finished" podID="5d26654b-c9a9-448a-a226-81e5c6a7871f" containerID="7a73ac600f6076f7b4f2b5d44e557c31586e9944613f176e7b37b8e5daeb13c8" exitCode=137 Oct 30 22:44:23.677770 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.677588 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" event={"ID":"5d26654b-c9a9-448a-a226-81e5c6a7871f","Type":"ContainerDied","Data":"7a73ac600f6076f7b4f2b5d44e557c31586e9944613f176e7b37b8e5daeb13c8"} Oct 30 22:44:23.677770 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.677607 5052 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" Oct 30 22:44:23.677770 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.677615 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj" event={"ID":"5d26654b-c9a9-448a-a226-81e5c6a7871f","Type":"ContainerDied","Data":"87a8cbf283b7793f594eaeb18cfa16ab0fc78711599d17582b6c3877dd638f91"} Oct 30 22:44:23.685215 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.685193 5052 scope.go:122] "RemoveContainer" containerID="8721d2b314402a4917a116ceab2e0d104e454fa73b1a47a12747f5181ee9ce74" Oct 30 22:44:23.685657 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:44:23.685448 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8721d2b314402a4917a116ceab2e0d104e454fa73b1a47a12747f5181ee9ce74\": container with ID starting with 8721d2b314402a4917a116ceab2e0d104e454fa73b1a47a12747f5181ee9ce74 not found: ID does not exist" containerID="8721d2b314402a4917a116ceab2e0d104e454fa73b1a47a12747f5181ee9ce74" Oct 30 22:44:23.685657 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.685475 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8721d2b314402a4917a116ceab2e0d104e454fa73b1a47a12747f5181ee9ce74"} err="failed to get container status \"8721d2b314402a4917a116ceab2e0d104e454fa73b1a47a12747f5181ee9ce74\": rpc error: code = NotFound desc = could not find container \"8721d2b314402a4917a116ceab2e0d104e454fa73b1a47a12747f5181ee9ce74\": container with ID starting with 8721d2b314402a4917a116ceab2e0d104e454fa73b1a47a12747f5181ee9ce74 not found: ID does not exist" Oct 30 22:44:23.685657 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.685493 5052 scope.go:122] "RemoveContainer" containerID="7a73ac600f6076f7b4f2b5d44e557c31586e9944613f176e7b37b8e5daeb13c8" Oct 30 22:44:23.693002 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.692983 5052 scope.go:122] "RemoveContainer" containerID="7a73ac600f6076f7b4f2b5d44e557c31586e9944613f176e7b37b8e5daeb13c8" Oct 30 22:44:23.693245 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:44:23.693227 5052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a73ac600f6076f7b4f2b5d44e557c31586e9944613f176e7b37b8e5daeb13c8\": container with ID starting with 7a73ac600f6076f7b4f2b5d44e557c31586e9944613f176e7b37b8e5daeb13c8 not found: ID does not exist" containerID="7a73ac600f6076f7b4f2b5d44e557c31586e9944613f176e7b37b8e5daeb13c8" Oct 30 22:44:23.693298 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.693252 5052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a73ac600f6076f7b4f2b5d44e557c31586e9944613f176e7b37b8e5daeb13c8"} err="failed to get container status \"7a73ac600f6076f7b4f2b5d44e557c31586e9944613f176e7b37b8e5daeb13c8\": rpc error: code = NotFound desc = could not find container \"7a73ac600f6076f7b4f2b5d44e557c31586e9944613f176e7b37b8e5daeb13c8\": container with ID starting with 7a73ac600f6076f7b4f2b5d44e557c31586e9944613f176e7b37b8e5daeb13c8 not found: ID does not exist" Oct 30 22:44:23.701471 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.701447 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j"] Oct 30 22:44:23.705702 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.705683 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-a3ce8b9d69/model-chainer-69f597b54c-8hb4j"] Oct 30 22:44:23.717154 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.717136 5052 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj"] Oct 30 22:44:23.723539 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:23.723521 5052 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-a3ce8b9d69/sequence-graph-e9913-767b8c8c7d-kzdqj"] Oct 30 22:44:24.607427 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:24.607396 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5d26654b-c9a9-448a-a226-81e5c6a7871f" path="/var/lib/kubelet/pods/5d26654b-c9a9-448a-a226-81e5c6a7871f/volumes" Oct 30 22:44:24.607799 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:24.607725 5052 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f51a0c9e-6e5b-4220-aa8e-d3edd389b738" path="/var/lib/kubelet/pods/f51a0c9e-6e5b-4220-aa8e-d3edd389b738/volumes" Oct 30 22:44:30.440778 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:30.439646 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:44:30.558290 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:30.558257 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:44:32.399549 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:32.399514 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:44:33.401025 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.400992 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:44:33.669666 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.669580 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s6gzr/must-gather-qkmsg"] Oct 30 22:44:33.670018 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.669979 5052 cpu_manager.go:414] "containerMap: removing container" podUID="5d26654b-c9a9-448a-a226-81e5c6a7871f" containerName="sequence-graph-e9913" Oct 30 22:44:33.670018 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670001 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5d26654b-c9a9-448a-a226-81e5c6a7871f" containerName="sequence-graph-e9913" Oct 30 22:44:33.670018 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670013 5052 cpu_manager.go:414] "containerMap: removing container" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kube-rbac-proxy" Oct 30 22:44:33.670222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670022 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kube-rbac-proxy" Oct 30 22:44:33.670222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670040 5052 cpu_manager.go:414] "containerMap: removing container" podUID="a45babc0-c279-42f0-a0a0-042aaf4b7b0b" containerName="switch-graph-7f5ed" Oct 30 22:44:33.670222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670047 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a45babc0-c279-42f0-a0a0-042aaf4b7b0b" containerName="switch-graph-7f5ed" Oct 30 22:44:33.670222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670058 5052 cpu_manager.go:414] "containerMap: removing container" podUID="0ff95ba5-a945-4695-a432-3ab8af8093ad" containerName="switch-graph-3c7da" Oct 30 22:44:33.670222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670065 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ff95ba5-a945-4695-a432-3ab8af8093ad" containerName="switch-graph-3c7da" Oct 30 22:44:33.670222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670078 5052 cpu_manager.go:414] "containerMap: removing container" podUID="f51a0c9e-6e5b-4220-aa8e-d3edd389b738" containerName="model-chainer" Oct 30 22:44:33.670222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670084 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f51a0c9e-6e5b-4220-aa8e-d3edd389b738" containerName="model-chainer" Oct 30 22:44:33.670222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670096 5052 cpu_manager.go:414] "containerMap: removing container" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kserve-container" Oct 30 22:44:33.670222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670103 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kserve-container" Oct 30 22:44:33.670222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670118 5052 cpu_manager.go:414] "containerMap: removing container" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kserve-container" Oct 30 22:44:33.670222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670125 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kserve-container" Oct 30 22:44:33.670222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670136 5052 cpu_manager.go:414] "containerMap: removing container" podUID="30caa0e5-5eba-4fb8-98e7-c99e892a20c7" containerName="splitter-graph-b14c2" Oct 30 22:44:33.670222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670144 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30caa0e5-5eba-4fb8-98e7-c99e892a20c7" containerName="splitter-graph-b14c2" Oct 30 22:44:33.670222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670181 5052 cpu_manager.go:414] "containerMap: removing container" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kube-rbac-proxy" Oct 30 22:44:33.670222 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670189 5052 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kube-rbac-proxy" Oct 30 22:44:33.670994 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670308 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kube-rbac-proxy" Oct 30 22:44:33.670994 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670321 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="5d26654b-c9a9-448a-a226-81e5c6a7871f" containerName="sequence-graph-e9913" Oct 30 22:44:33.670994 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670331 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kube-rbac-proxy" Oct 30 22:44:33.670994 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670340 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="a45babc0-c279-42f0-a0a0-042aaf4b7b0b" containerName="switch-graph-7f5ed" Oct 30 22:44:33.670994 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670349 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ff95ba5-a945-4695-a432-3ab8af8093ad" containerName="switch-graph-3c7da" Oct 30 22:44:33.670994 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670358 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="f51a0c9e-6e5b-4220-aa8e-d3edd389b738" containerName="model-chainer" Oct 30 22:44:33.670994 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670366 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d39270b-70e2-4fa2-ad9e-7e9a1c736dad" containerName="kserve-container" Oct 30 22:44:33.670994 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670376 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="3c05206f-5658-462c-bf04-a34719028652" containerName="kserve-container" Oct 30 22:44:33.670994 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.670384 5052 memory_manager.go:365] "RemoveStaleState removing state" podUID="30caa0e5-5eba-4fb8-98e7-c99e892a20c7" containerName="splitter-graph-b14c2" Oct 30 22:44:33.673769 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.673750 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s6gzr/must-gather-qkmsg" Oct 30 22:44:33.681128 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.681085 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s6gzr\"/\"kube-root-ca.crt\"" Oct 30 22:44:33.681128 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.681117 5052 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s6gzr\"/\"default-dockercfg-bdjbc\"" Oct 30 22:44:33.681291 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.681122 5052 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s6gzr\"/\"openshift-service-ca.crt\"" Oct 30 22:44:33.682540 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.682521 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s6gzr/must-gather-qkmsg"] Oct 30 22:44:33.687515 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.687488 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:44:33.742561 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.742537 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fb698cc4-3826-4131-a76a-d0cc3274347e-must-gather-output\") pod \"must-gather-qkmsg\" (UID: \"fb698cc4-3826-4131-a76a-d0cc3274347e\") " pod="openshift-must-gather-s6gzr/must-gather-qkmsg" Oct 30 22:44:33.742661 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.742574 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llxzv\" (UniqueName: \"kubernetes.io/projected/fb698cc4-3826-4131-a76a-d0cc3274347e-kube-api-access-llxzv\") pod \"must-gather-qkmsg\" (UID: \"fb698cc4-3826-4131-a76a-d0cc3274347e\") " pod="openshift-must-gather-s6gzr/must-gather-qkmsg" Oct 30 22:44:33.793013 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.792985 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:44:33.843118 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.843096 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fb698cc4-3826-4131-a76a-d0cc3274347e-must-gather-output\") pod \"must-gather-qkmsg\" (UID: \"fb698cc4-3826-4131-a76a-d0cc3274347e\") " pod="openshift-must-gather-s6gzr/must-gather-qkmsg" Oct 30 22:44:33.843200 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.843137 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llxzv\" (UniqueName: \"kubernetes.io/projected/fb698cc4-3826-4131-a76a-d0cc3274347e-kube-api-access-llxzv\") pod \"must-gather-qkmsg\" (UID: \"fb698cc4-3826-4131-a76a-d0cc3274347e\") " pod="openshift-must-gather-s6gzr/must-gather-qkmsg" Oct 30 22:44:33.843408 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.843394 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fb698cc4-3826-4131-a76a-d0cc3274347e-must-gather-output\") pod \"must-gather-qkmsg\" (UID: \"fb698cc4-3826-4131-a76a-d0cc3274347e\") " pod="openshift-must-gather-s6gzr/must-gather-qkmsg" Oct 30 22:44:33.855491 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:33.855466 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llxzv\" (UniqueName: \"kubernetes.io/projected/fb698cc4-3826-4131-a76a-d0cc3274347e-kube-api-access-llxzv\") pod \"must-gather-qkmsg\" (UID: \"fb698cc4-3826-4131-a76a-d0cc3274347e\") " pod="openshift-must-gather-s6gzr/must-gather-qkmsg" Oct 30 22:44:34.000848 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:34.000821 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s6gzr/must-gather-qkmsg" Oct 30 22:44:34.276523 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:34.276498 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s6gzr/must-gather-qkmsg"] Oct 30 22:44:34.278991 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:44:34.278963 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb698cc4_3826_4131_a76a_d0cc3274347e.slice/crio-d0da185b04c008134c5ab03ecb9c6663dbec0ef460e5cdaf0594c70394bf950d WatchSource:0}: Error finding container d0da185b04c008134c5ab03ecb9c6663dbec0ef460e5cdaf0594c70394bf950d: Status 404 returned error can't find the container with id d0da185b04c008134c5ab03ecb9c6663dbec0ef460e5cdaf0594c70394bf950d Oct 30 22:44:34.280805 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:34.280789 5052 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:44:34.729565 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:34.729530 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s6gzr/must-gather-qkmsg" event={"ID":"fb698cc4-3826-4131-a76a-d0cc3274347e","Type":"ContainerStarted","Data":"d0da185b04c008134c5ab03ecb9c6663dbec0ef460e5cdaf0594c70394bf950d"} Oct 30 22:44:34.989811 ip-10-0-140-139 kubenswrapper[5052]: E1030 22:44:34.989744 5052 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-rgkfs" containerName="extractor" Oct 30 22:44:35.738303 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:35.738088 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s6gzr/must-gather-qkmsg" event={"ID":"fb698cc4-3826-4131-a76a-d0cc3274347e","Type":"ContainerStarted","Data":"546310288d51bb876ba43bf61c10b7c81077297b11e3ebbe0319f63d3754c93e"} Oct 30 22:44:35.738303 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:35.738143 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s6gzr/must-gather-qkmsg" event={"ID":"fb698cc4-3826-4131-a76a-d0cc3274347e","Type":"ContainerStarted","Data":"231ce2cc89ecad40e21d62e26d34f2dca6aa64dca42a3b0740b1cc1a541fa2eb"} Oct 30 22:44:35.756647 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:35.756591 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-s6gzr/must-gather-qkmsg" podStartSLOduration=2.075145838 podStartE2EDuration="2.756574246s" totalImagesPullingTime="681.428408ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:44:35.755140246 +0000 UTC m=+3085.278180979" watchObservedRunningTime="2026-10-30 22:44:35.756574246 +0000 UTC m=+3085.279614980" Oct 30 22:44:36.605078 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:36.605045 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s5jhm_967b7974-ef9d-4eff-8265-879c05e6fc96/global-pull-secret-syncer/0.log" Oct 30 22:44:36.633907 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:36.633883 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-bqtvv_8328c2d0-1c49-4619-8ccc-4a238ce29121/connection-checker/0.log" Oct 30 22:44:36.660272 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:36.660243 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-n2r6j_c7c738de-1f94-4fb0-a389-84512dcb22b9/connection-checker/0.log" Oct 30 22:44:36.690035 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:36.690012 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-zswrm_7f473fc1-7e45-4581-9426-009af0a1682b/connection-checker/0.log" Oct 30 22:44:36.780517 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:36.780478 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" Oct 30 22:44:36.992439 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:36.992408 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-139.us-east-2.compute.internal_b10322e84c5fc9db7c569a5553b27b9d/haproxy/0.log" Oct 30 22:44:38.038360 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:38.037929 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:44:38.146491 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:38.146455 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:44:39.142878 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:39.137911 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:44:39.265668 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:39.264336 5052 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25wb5_57645c9d-50be-44cf-8ae7-c0c3103b2a78/konnectivity-agent/0.log" limit=1024 Oct 30 22:44:42.096883 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:42.096081 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-d6jlp_4846560b-5370-4fa1-8d36-43dfc4011191/cluster-monitoring-operator/0.log" Oct 30 22:44:42.344287 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:42.342667 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h6b55_567c7e26-46be-4b2e-8db7-3499cc5229f0/node-exporter/0.log" Oct 30 22:44:42.372378 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:42.372308 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h6b55_567c7e26-46be-4b2e-8db7-3499cc5229f0/kube-rbac-proxy/0.log" Oct 30 22:44:42.404285 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:42.403142 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h6b55_567c7e26-46be-4b2e-8db7-3499cc5229f0/init-textfile/0.log" Oct 30 22:44:42.967879 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:42.965016 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-jrzf8_414c4be8-0ec0-4901-82da-015aa16e5350/prometheus-operator/0.log" Oct 30 22:44:43.006536 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:43.006476 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-jrzf8_414c4be8-0ec0-4901-82da-015aa16e5350/kube-rbac-proxy/0.log" Oct 30 22:44:43.031917 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:43.031886 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-kl7hg_ef4d3c62-59b9-4127-ba60-06594bcf3c1d/prometheus-operator-admission-webhook/0.log" Oct 30 22:44:44.412469 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.412436 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-4fs6t_38da3026-ac7f-44af-aa6c-f16cf3082c9e/networking-console-plugin/0.log" Oct 30 22:44:44.533091 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.533049 5052 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc"] Oct 30 22:44:44.536654 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.536628 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.552452 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.552393 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc"] Oct 30 22:44:44.708937 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.708841 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0f52578-d9e2-40aa-92d5-59f3df373f15-sys\") pod \"perf-node-gather-daemonset-tnxmc\" (UID: \"c0f52578-d9e2-40aa-92d5-59f3df373f15\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.708937 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.708913 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0f52578-d9e2-40aa-92d5-59f3df373f15-podres\") pod \"perf-node-gather-daemonset-tnxmc\" (UID: \"c0f52578-d9e2-40aa-92d5-59f3df373f15\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.709182 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.709018 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsfgv\" (UniqueName: \"kubernetes.io/projected/c0f52578-d9e2-40aa-92d5-59f3df373f15-kube-api-access-fsfgv\") pod \"perf-node-gather-daemonset-tnxmc\" (UID: \"c0f52578-d9e2-40aa-92d5-59f3df373f15\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.709182 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.709054 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0f52578-d9e2-40aa-92d5-59f3df373f15-proc\") pod \"perf-node-gather-daemonset-tnxmc\" (UID: \"c0f52578-d9e2-40aa-92d5-59f3df373f15\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.709182 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.709087 5052 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0f52578-d9e2-40aa-92d5-59f3df373f15-lib-modules\") pod \"perf-node-gather-daemonset-tnxmc\" (UID: \"c0f52578-d9e2-40aa-92d5-59f3df373f15\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.811644 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.809834 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0f52578-d9e2-40aa-92d5-59f3df373f15-sys\") pod \"perf-node-gather-daemonset-tnxmc\" (UID: \"c0f52578-d9e2-40aa-92d5-59f3df373f15\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.811644 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.809910 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0f52578-d9e2-40aa-92d5-59f3df373f15-podres\") pod \"perf-node-gather-daemonset-tnxmc\" (UID: \"c0f52578-d9e2-40aa-92d5-59f3df373f15\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.811644 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.809966 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsfgv\" (UniqueName: \"kubernetes.io/projected/c0f52578-d9e2-40aa-92d5-59f3df373f15-kube-api-access-fsfgv\") pod \"perf-node-gather-daemonset-tnxmc\" (UID: \"c0f52578-d9e2-40aa-92d5-59f3df373f15\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.811644 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.809992 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0f52578-d9e2-40aa-92d5-59f3df373f15-proc\") pod \"perf-node-gather-daemonset-tnxmc\" (UID: \"c0f52578-d9e2-40aa-92d5-59f3df373f15\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.811644 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.810027 5052 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0f52578-d9e2-40aa-92d5-59f3df373f15-lib-modules\") pod \"perf-node-gather-daemonset-tnxmc\" (UID: \"c0f52578-d9e2-40aa-92d5-59f3df373f15\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.811644 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.810057 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0f52578-d9e2-40aa-92d5-59f3df373f15-podres\") pod \"perf-node-gather-daemonset-tnxmc\" (UID: \"c0f52578-d9e2-40aa-92d5-59f3df373f15\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.811644 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.810184 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0f52578-d9e2-40aa-92d5-59f3df373f15-lib-modules\") pod \"perf-node-gather-daemonset-tnxmc\" (UID: \"c0f52578-d9e2-40aa-92d5-59f3df373f15\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.811644 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.810232 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0f52578-d9e2-40aa-92d5-59f3df373f15-proc\") pod \"perf-node-gather-daemonset-tnxmc\" (UID: \"c0f52578-d9e2-40aa-92d5-59f3df373f15\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.811644 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.810464 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0f52578-d9e2-40aa-92d5-59f3df373f15-sys\") pod \"perf-node-gather-daemonset-tnxmc\" (UID: \"c0f52578-d9e2-40aa-92d5-59f3df373f15\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.823964 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.823925 5052 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsfgv\" (UniqueName: \"kubernetes.io/projected/c0f52578-d9e2-40aa-92d5-59f3df373f15-kube-api-access-fsfgv\") pod \"perf-node-gather-daemonset-tnxmc\" (UID: \"c0f52578-d9e2-40aa-92d5-59f3df373f15\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.852122 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.851903 5052 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:44.980822 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.980790 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/2.log" Oct 30 22:44:44.990050 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:44.990013 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-hn7m5_7c068922-cad3-472a-a20a-890955ecb231/console-operator/3.log" Oct 30 22:44:45.139873 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:45.139827 5052 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc"] Oct 30 22:44:45.143702 ip-10-0-140-139 kubenswrapper[5052]: W1030 22:44:45.143670 5052 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc0f52578_d9e2_40aa_92d5_59f3df373f15.slice/crio-5d1833a757c0608ac0ad55c1d5a3735da1043d70ea8e5d06a1adac517bc3c493 WatchSource:0}: Error finding container 5d1833a757c0608ac0ad55c1d5a3735da1043d70ea8e5d06a1adac517bc3c493: Status 404 returned error can't find the container with id 5d1833a757c0608ac0ad55c1d5a3735da1043d70ea8e5d06a1adac517bc3c493 Oct 30 22:44:45.474532 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:45.474500 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-f2tqb_5d61a3c1-7782-49be-9760-ec2025db2f82/download-server/0.log" Oct 30 22:44:45.817728 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:45.817682 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" event={"ID":"c0f52578-d9e2-40aa-92d5-59f3df373f15","Type":"ContainerStarted","Data":"71a796a2ab137c3d4a53cdc0bc0c3c703790512a51b60b470d9d17282daf47a8"} Oct 30 22:44:45.817936 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:45.817735 5052 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" event={"ID":"c0f52578-d9e2-40aa-92d5-59f3df373f15","Type":"ContainerStarted","Data":"5d1833a757c0608ac0ad55c1d5a3735da1043d70ea8e5d06a1adac517bc3c493"} Oct 30 22:44:45.817936 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:45.817828 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:45.836784 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:45.836736 5052 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" podStartSLOduration=1.836723202 podStartE2EDuration="1.836723202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:44:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:44:45.835789283 +0000 UTC m=+3095.358830018" watchObservedRunningTime="2026-10-30 22:44:45.836723202 +0000 UTC m=+3095.359763935" Oct 30 22:44:46.001103 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:46.001074 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-l9ktm_6f371722-dc8f-48eb-8f8c-28f394ef4360/volume-data-source-validator/0.log" Oct 30 22:44:47.056370 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:47.056339 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sq7zn_3d901cac-9d8d-48f8-b1a6-61ae43d46721/dns/0.log" Oct 30 22:44:47.095235 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:47.095205 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sq7zn_3d901cac-9d8d-48f8-b1a6-61ae43d46721/kube-rbac-proxy/0.log" Oct 30 22:44:47.229468 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:47.229434 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4d225_4d4e36e4-7ca2-4e4f-837d-ebdef77734b1/dns-node-resolver/0.log" Oct 30 22:44:47.836698 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:47.836666 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-9976cb5f8-znt8v_cdecbe83-a78d-45d2-bca9-89c4bb2857d5/registry/0.log" Oct 30 22:44:47.924264 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:47.924235 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dgfl4_dc21c8c5-43ec-4e83-8cf7-5d0d5d4d109a/node-ca/0.log" Oct 30 22:44:48.709158 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:48.709118 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c8767fbdc-sxmpb_cc3ee40a-be4e-476f-91ff-a0cd164812fc/router/0.log" Oct 30 22:44:49.153474 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:49.153446 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sgzrz_181f4022-4f53-4e23-8424-01f6b5e06ec6/serve-healthcheck-canary/0.log" Oct 30 22:44:49.587438 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:49.587406 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-frqg6_3cfcee7d-4a08-441e-874b-5486b381d0f2/insights-operator/1.log" Oct 30 22:44:49.590269 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:49.590245 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-frqg6_3cfcee7d-4a08-441e-874b-5486b381d0f2/insights-operator/2.log" Oct 30 22:44:49.774303 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:49.774277 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rgkfs_9101efec-ec15-4f30-929d-a3bcfd851caa/kube-rbac-proxy/0.log" Oct 30 22:44:49.797477 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:49.797449 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rgkfs_9101efec-ec15-4f30-929d-a3bcfd851caa/exporter/0.log" Oct 30 22:44:49.821438 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:49.821397 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rgkfs_9101efec-ec15-4f30-929d-a3bcfd851caa/extractor/0.log" Oct 30 22:44:49.863721 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:49.863653 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-7s6vk-q8p7z_39dc3095-a843-42c3-abce-2c44331991ec/insights-gathering/0.log" Oct 30 22:44:51.834164 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:51.834133 5052 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-tnxmc" Oct 30 22:44:57.085896 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:57.085851 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-bl46l_daafa095-7904-4d87-ad51-83577c6d1452/migrator/0.log" Oct 30 22:44:57.112282 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:57.112256 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-lhvx9_187603a7-5181-4c01-b7d2-3d7a56796255/migrator/0.log" Oct 30 22:44:57.440572 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:57.440493 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl_88107d0e-6b47-4320-8647-2a597f418bf4/kube-storage-version-migrator-operator/1.log" Oct 30 22:44:57.442045 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:57.442017 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-x6ffl_88107d0e-6b47-4320-8647-2a597f418bf4/kube-storage-version-migrator-operator/0.log" Oct 30 22:44:58.310829 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:58.310799 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7s4gp_d30d11f1-faf2-4cf7-8d92-7bdda003b7c1/kube-multus/0.log" Oct 30 22:44:58.709086 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:58.709014 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vpw8h_cfb5127e-d35c-4d71-9565-b8044e41f2bc/kube-multus-additional-cni-plugins/0.log" Oct 30 22:44:58.734398 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:58.734365 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vpw8h_cfb5127e-d35c-4d71-9565-b8044e41f2bc/egress-router-binary-copy/0.log" Oct 30 22:44:58.758896 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:58.758845 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vpw8h_cfb5127e-d35c-4d71-9565-b8044e41f2bc/cni-plugins/0.log" Oct 30 22:44:58.784263 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:58.784238 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vpw8h_cfb5127e-d35c-4d71-9565-b8044e41f2bc/bond-cni-plugin/0.log" Oct 30 22:44:58.815510 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:58.815489 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vpw8h_cfb5127e-d35c-4d71-9565-b8044e41f2bc/routeoverride-cni/0.log" Oct 30 22:44:58.844058 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:58.844031 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vpw8h_cfb5127e-d35c-4d71-9565-b8044e41f2bc/whereabouts-cni-bincopy/0.log" Oct 30 22:44:58.868121 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:58.868100 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vpw8h_cfb5127e-d35c-4d71-9565-b8044e41f2bc/whereabouts-cni/0.log" Oct 30 22:44:59.036492 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:59.036467 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ztlk7_b6b30cd9-d376-4e9e-8f95-d4d2c504cd93/network-metrics-daemon/0.log" Oct 30 22:44:59.064062 ip-10-0-140-139 kubenswrapper[5052]: I1030 22:44:59.064029 5052 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ztlk7_b6b30cd9-d376-4e9e-8f95-d4d2c504cd93/kube-rbac-proxy/0.log"